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Executive Summary 


One of the most important things school systems can do to promote student achievement is to ensure 
that all students have effective teachers. In fact, effective teachers may be particularly important for our 
most disadvantaged students (e.g., Gordon, Kane and Staiger 2006). Over the years, however, research 
has shown that many of our traditional methods of ensuring teacher effectiveness, such as requiring 
particular credentials, experience, or education, are not strongly related to teachers’ effectiveness in 
promoting student achievement (for example, see Wayne and Youngs 2003; Kane, Rockoff and Staiger 
2008). In response, federal, state and district policymakers are increasingly investing in alternative 
measures of teacher effectiveness, including data on growth in student achievement, as well as new or 
revised measures of instructional practice. With improvements in the ways teacher effectiveness is 
measured, new opportunities are available for states and districts to use information about teachers’ 
effectiveness in districtwide human resource policies and in efforts focused on ensuring equity. 


The U.S. Department of Education commissioned the American Institutes for Research (AIR) to create 
this report as a resource for state and district policymakers who are working to ensure that all students, 
regardless of background, have effective teachers. This report is intended to illustrate the steps districts 
take and the challenges they face in assessing teacher effectiveness as a precursor to providing effective 
teachers for all students. In so doing, the report focuses on three areas of state and district policy that 
play a mutually reinforcing role in promoting equitable access to effective teachers: 


1. Identifying effective teachers. The first challenge to ensuring equitable access to effective 
teachers is the development of better measures to identify teacher effectiveness. States and 
districts are starting to develop measures of teacher quality that rely directly on student academic 
growth and on observations of teachers’ practice. These two types of measures—treferred to here 
as measures of effectiveness—generate information that can be used in human resource policies and 
in efforts to ensure equity. 


2. Using information about teacher effectiveness in human resource policies. Where 
information about teacher effectiveness is available, states and districts are beginning to 
incorporate this information into the design of human resource policies including recruitment, 
selection and placement, induction, mentoring, professional development, performance 
management (i.e., evaluation), compensation and instructional leadership (Odden and Kelly 
2008). The use of information about teacher effectiveness in human resoutce policies is a key 
component of efforts to ensure that all students have effective teachers (Weisberg and others 


2009). 


3. Using information about teachers’ effectiveness in efforts to ensure equity. While 
districtwide human resource policies are necessary for ensuring that all students have effective 
teachers, such policies may not be sufficient. Studies have documented that, on average, teachers 
migrate toward working in affluent, high achieving schools (Hanushek, Kain and Rivkin 2004; 
Goldhaber 2008). ’Thus, another component of efforts to ensure that all students have effective 
teachers is a set of policies that specifically targets high-need schools. On the basis of 
information about teachers’ effectiveness, states and districts can monitor the effectiveness of 
teachers in high-need schools, in comparison with other schools (see, e.g., Tennessee 
Department of Education 2007; Carr and Oxnam 2009), and use information about teacher 
effectiveness to design targeted programs for high-need schools. For example, incentives to 
teach in high-need schools can be offered to effective teachers only, rather than to all teachers. 
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This report draws on the experiences of five districts to provide examples that may be relevant to state 
and district policymakers considering action in these three areas. The five districts are: 


e Columbus City Schools (Ohio) 

e Eagle County Schools (Colorado) 

e Hamilton County Public Schools (Tennessee) 
e Hillsborough County Public Schools (Florida) 


e Houston Independent School District (Texas) 
The report addresses three questions: 


1. How did the districts identify effective teachers and what were some of the challenges associated 
with the measures that the districts used? 


2. How did the districts use information about teachers’ effectiveness in human resource policies? 


3. How did the districts use information about teachers’ effectiveness in their efforts to make the 
distribution of effective teachers more equitable? 


By summer 2010, all five districts had begun to measure teacher effectiveness through student 
achievement growth in at least some schools and most were implementing new classroom observations 
of teachers’ practice. By summer 2010, the five districts had used those measures in human resource 
policies in a variety of ways, and some had other policies in place for promoting equitable access to 
effective teachers. AIR staff visited each district in June and July of 2010 to learn about their specific 
approaches to teacher effectiveness, including the way the districts selected those approaches and 
resolved key dilemmas and challenges. 


This report highlights examples of the way study districts identified effective teachers, and draws on that 
information for human resource policies and efforts to ensure equity. Because most of the practices 
discussed in this report are relatively new and will likely be refined over time, monitoring and evaluation 
will allow districts and states to determine whether their actions are successful and to adjust their 
practices accordingly. 


Identifying Effective Teachers 


As of July 2010, the five study districts had developed measures of teacher effectiveness that drew on 
data on student achievement growth and four had measures of classroom practice. While the reasons for 
developing these measures varied, compensation reform was a key driver in four of the five districts. 
Specifically, Columbus, Eagle County, Hillsborough, and Houston all developed or improved their 
measures of teacher effectiveness in order to offer performance incentives for high-performing teachers 
districtwide or in select schools. Funding for performance incentives or to support the development of 
measures came from different sources at different times. For example, Eagle County’s efforts began 
with local funds which were supplemented later with TIF funds. As of summer 2010, Hamilton County, 
Columbus, and Hillsborough planned to continue their work to develop and refine measures of teacher 
effectiveness as part of their states’ Race to the Top grant efforts. All the districts’ efforts suggest a 
number of key challenges that other districts and states may need to address as they consider developing 
measures of teacher effectiveness: 
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e Communication and engagement. Interviewees noted the importance of efforts to ensure 
that teachers and principals were appropriately informed about new measures of teacher 
effectiveness. Whether with respect to the design of a new measure or to its implementation, 
study districts responded to the need to allow for input and to provide clear and comprehensive 
information to teachers and principals in a variety of ways. Some provided opportunities for 
teachers or others to help develop or refine measures like classroom observation frameworks. 
Others focused on providing information about their measures. One provided a systematic, 
ongoing process by mandating regular stakeholder input for updates to the teacher evaluation 
process. 


e Limited scope of student achievement growth measures. A key challenge for study districts 
was the fact that data on student achievement growth were available only for teachers in grades 
and subjects in which state tests were implemented. Study districts used different approaches to 
supplement these measures, including creating or repurposing other district assessments, or 
applying schoolwide or other aggregate measures to teachers in untested grades or subjects. 


e Implementation of classroom observation frameworks. Interviewees noted challenges in 
implementing classroom observation systems that were both rigorous and feasible. For example, 
interviewees noted challenges in finding the right observers and in ensuring and maintaining 
reliability. Study districts took a variety of approaches in response to these challenges, including 
providing scheduling support, providing ongoing training, and working with teachers and 
principals to identify the right observers for each district’s context. 


Using Information About Teachers’ Effectiveness in Human Resource 
Policies 


The five study districts had developed policies for using effectiveness information in their human 
resource policies. Across the districts, there were policies or programs to address the entire continuum of 
teacher employment and development, from hiring to dismissal, but study districts most often focused 
on the following: 


e Compensation initiatives. All study districts except Hamilton County had in place 
performance pay initiatives that made use of differing teacher effectiveness measures. As noted 
earlier, these programs often served as the impetus to design or redesign teacher effectiveness 
measures. 


e Feedback through observation. Where study districts had new or revised observation 
frameworks in place, these frameworks appeared to serve as a linchpin in district efforts to 
provide useful feedback to teachers and aid them to improve their instructional practices. The 
format of the observations and feedback varied from district to district. 


e Career paths. Several interviewees spoke about their efforts to use effectiveness information to 
identify teachers for leadership positions, as well as to release those they determined to be 
ineffective. Districts used different types of information for these purposes. For example, 
Houston described using value-added data as a potential source of evidence for dismissal and for 
granting leadership opportunities; Eagle County spoke about using observational data for 
dismissal purposes and Columbus noted how it could be used for identifying potential teacher 
leaders. 
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Taking Targeted Action to Improve Equitable Access to Effective 
Teachers 


Several of the five study districts had developed policies for using effectiveness information in efforts to 
ensure teacher effectiveness in high-need schools. One district, Houston, analyzed effectiveness 
information to determine where inequities within the district might be. The focus of most study districts 
was monetary incentives to attract and retain effective teachers in high-need schools. In one case, 
Houston’s Effective Teacher Pipeline project, such incentives were paired with efforts to address 
working conditions in high-need schools by encouraging movement of many effective teachers to a small 
set of high-priority, high-need schools. Placing multiple effective teachers in high-need schools was 
intended to create a culture of supportive peers. 


The study districts and many other districts around the nation are at the forefront of learning how to 
ensure teacher effectiveness for all students, and their experiences may prove informative to others. In 
addition to the performance of ongoing monitoring and adjustments, districts can learn from one 
another about teacher evaluation strategies. This report is one step in that direction. 
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I. Introduction and Overview 


This report is intended to illustrate the steps districts take and the challenges they face in assessing 
teacher effectiveness as a precursor to providing effective teachers for all students. The report draws on 
descriptive information from case studies of five districts that have developed and implemented new 
measures of teacher effectiveness based on gains in student achievement, observations of instructional 
practice, or based on both types of data. The report discusses the ways these districts are using such 
measures in their human resource policies, including efforts to ensure the equitable distribution of 
effective teachers. Research has documented the importance of having effective teachers. For example, 
Gordon, Kane and Staiger (2006) found that students who had teachers in the top quartile of 
effectiveness gained 10 achievement percentile points relative to similar students who had teachers in the 
bottom quartile of effectiveness. 


Federal programs have increasingly focused on teacher quality as a tool for closing achievement gaps. 
The most recent reauthorization of the E/ementary and Secondary Education Act (ESEA) in 2002 placed 
substantial policy emphasis on the key role of teachers by requiring that, by the end of the 2005-06 
school year, all core subjects be taught by highly qualified teachers (HQTs).! In addition, ESEA required 
that states provide assurances and develop plans to “ensure that poor and minority children are not 
taught at higher rates than other children by inexperienced, unqualified, or out of field teachers” (Section 
1111(b)(8)(©)). In 2009, the American Recovery and Reinvestment Act (ARRA) requirements reinforced the 
focus on equitable distribution of teachers by requiring states applying for education stimulus (State 
Fiscal Stabilization) funds to provide updated assurances and to publicize their plans to address potential 
inequities. ARRA also established competitive grants to help states build their pool of effective teachers 
and address inequities in the distribution of teachers, through, for example, the Race to the Top (RTT) 
program, for which one priority area is effective teachers and leaders. 


In addition to their increasing focus on the role of teacher quality in improving student academic growth 
and closing achievement gaps, federal programs have been promoting shifts in the way teacher quality is 
measured, away from a primary focus on teacher qualifications and credentials and toward effectiveness. 
In this report, the term measure of teacher effectiveness is used to refer to measures based on growth in 
student achievement, teacher practice, and a combination of these two approaches. Among the 
arguments supporting this shift, recent research has documented the limited extent to which commonly 
measured qualifications, such as possession of a mastet’s degree, are related to student outcomes (for 
example, see Wayne and Youngs 2003; Kane, Rockoff and Staiger 2008). In response to these findings 
and to several current federal and foundation initiatives, states and districts have begun to use data on 
growth in student achievement, as well as new or revised measures of instructional practice, to judge 
teacher effectiveness. Federal programs such as the Teacher Incentive Fund (TIF) and RTT have 
provided incentives for states and districts to move in this direction, including funds to support some of 
the technical aspects of developing measures of teacher quality. 


With improvements in the way teacher quality is measured, new opportunities are available for states and 
districts to examine whether students in high-need schools are as likely as other students to have 
effective teachers. For decades, data on teacher qualifications have indicated that students in 
high-poverty and high-minority schools are less likely than others to have teachers with certain 
qualifications. For example, studies have found that students in high-poverty or high-minority schools 


! The federal definition of highly qualified is a teacher who is fully certified and/or licensed by the state in which he or 
she teaches, who holds at least a bachelor’s degree from a four-year institution, and who demonstrates competence in 
ways identified in the statute in each core academic subject area taught (No Chi/d Left Behind Act of 2001). 
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are more likely to be taught by less qualified and less experienced teachers (Coopersmith 2009; Clotfelter 
and others 2007; DeAngelis and others 2005). These students are more likely to be taught by “out-of- 
field” teachers, teachers who have neither certification nor a major in the subject that they are teaching 
(Education Trust 2008; Lashway 2004), or by teachers trained at less selective colleges or universities 
(Imazeki 2007; Wayne 2002). 


Today, analyses using data on growth in student achievement are available in some states and districts, 
and provide a sharper understanding of the distribution of teacher quality (see, e.g., Tennessee 
Department of Education 2007; Sass and others 2010). 


The Focus and Organization of This Report 


This report focuses on three areas of state and district policy that play a mutually reinforcing role in 
promoting equitable access to effective teachers. Policies in the first area, dentifying effective teachers, provide 
the foundation for policies in the latter two areas: using information about teachers’ effectiveness in human resource 
policies and using information about teachers’ effectiveness in efforts to ensure equity. 


1. Identifying effective teachers. The first challenge to ensuring equitable access to effective 
teachers is the development of better measures of teacher quality. States and districts are starting 
to develop measures of teacher quality that rely directly on student academic growth and on 
observations of teachers’ practice. These two types of measures—referred to here as “measures 
of effectiveness” —generate information that can be used in human resource policies and in 
efforts to ensure equity. 


2. Using information about teachers’ effectiveness in human resoutce policies. Where 
information about teacher effectiveness is available, states and districts are beginning to 
incorporate this information in the design of human resource policies. Odden and Kelly (2008) 
identify eight key areas of human resource policies: recruitment, selection and placement, 
induction, mentoring, professional development, performance management (evaluation), 
compensation, and instructional leadership. The use of information about teacher effectiveness 
in human resoutce policies is a key component of efforts to ensure that all students have 
effective teachers (Weisberg and others 2009). 


3. Using information about teachers’ effectiveness in efforts to ensure equity. While 
districtwide human resource policies are necessary for ensuring that all students have effective 
teachers, such policies are not sufficient. Studies have documented that, on average, teachers 
migrate toward working in affluent, high-achieving schools (Hanushek, Kain and Rivkin 2004; 
Goldhaber 2008). Thus, another component of efforts to ensure that all students have effective 
teachers is a set of policies that specifically target high-need schools. On the basis of information 
about teachers’ effectiveness, states and districts can monitor the effectiveness of teachers in 
high-need schools, in comparison with teachers in other schools (see, for example, Tennessee 
Department of Education 2007; Carr and Oxnam 2009). States and districts can also use 
information about teacher effectiveness in the design of targeted monetary and nonmonetary 
incentives for high-need schools. For example, incentives to teach in high-need schools can be 
offered to effective teachers only, rather than to all teachers. 


This report includes one chapter on each of these three policy areas, drawing on a group of five study 


districts as a source of concrete examples of actions in these areas. The report addresses three main 
questions: 
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1. How did the districts identify effective teachers and what were some of the challenges associated 
with the measures that the districts used? 


2. How did the districts use information about teachers! effectiveness in human resoutce policies? 


3. How did the districts use information about teachers’ effectiveness in their efforts to make the 
distribution of effective teachers more equitable? 


The appendixes provide additional concrete examples (Appendix A), profiles of each of the five districts 
(Appendix B), a description of study methods (Appendix C), and a list of resources for further support 
(Appendix D). 


The Five Districts Profiled for This Report 


This report draws on the experiences of five districts to provide concrete examples that may be relevant 
to state and district policymakers considering similar approaches. The districts vary in size and region, 
from very large and urban to small and rural. The five districts are 


e Columbus City Schools (Ohio) 

e Eagle County Schools (Colorado) 

e Hamilton County Public Schools (Tennessee) 
e Hillsborough County Public Schools (Florida) 


e Houston Independent School District (Texas) 


AIR selected the five districts because, by summer 2010, all had begun to measure teacher effectiveness 
through student achievement growth in at least some schools and most were implementing 
newclassroom observation of teachers’ practice. They had also used such measures in a variety of human 
resource policies, and three of the districts had at least one policy for using such measures to promote 
equitable access to effective teachers. Several of the districts had received private, federal, or state grants 
which supported their efforts to measure effectiveness or use effectiveness data in human resource 
policies. For example, Eagle County and Houston were TIF grantees; Columbus received TIF funds 
through a grant to the state of Ohio. Hamilton County, Hillsborough County, and Columbus were all 
expecting to receive Race to the Top funds through their states. The site descriptions at the end of this 
report provide more information about each district and funding supports received for their efforts. 


AIR visited each district in June and July 2010 to interview district-level staff, teachers’ association or 
union representatives and principals about current and planned approaches to gathering and using 
information on teacher effectiveness, including the ways in which the districts selected those approaches 
and resolved key dilemmas and challenges. AIR also collected and analyzed documents both before and 
during site visits. AIR prepared a summary report for each district and shared each report with the 
district for verification. In some cases, districts noted during AIR visits that they were in the process of 
making changes to their policies and practices related to teacher effectiveness. These changes were noted 
when they were described to interviewers. This report focuses primarily on strategies or policies in place 
as of AIR’s visits in summer 2010. 


The chapters that follow describe the policies and practices in use in each district as of summer 2010, as 
summarized in Exhibit 1 and the bulleted items below: 
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e All five districts used student achievement growth as one measure of teacher effectiveness for 
some or all teachers. Several districts were updating these student achievement growth measures. 
In addition, four districts used new or revised observation-based assessments or were in the 
process of developing them (see chapter I). 


e A\ll five districts used their measures of teacher effectiveness in some human resoutce policies. 
For example, four used effectiveness information in performance pay initiatives, and five 
planned to use data from their observation frameworks or student achievement scores to guide 
professional development decisions. Three districts promoted the use of effectiveness 
information to remove ineffective teachers. Many of these practices were in an early stage of 
development, with the districts making adjustments to traditional practices on the basis of a 
review of effectiveness information (see chapter III). 


e Three of the five districts had policies that targeted high-need schools, drawing on effectiveness 
information. All three offered financial incentives to teachers to move to or stay in high-need 
schools, and one had hiring and transfer policies designed to provide principals in high-need 
schools additional opportunities to hire effective teachers (see chapter IV). 


Exhibit 1 
Policies and Practices in Use in the Five Districts Profiled for This Report 


Districts 


Hamilton Hillsborough 
Policies Columbus Eagle County County County Houston 


Identifying Effective Teachers 
Value-added or student growth scores in use 
Classroom observation methods in use 


Using Information About Teachers’ 
Effectiveness in Human Resource Policies 


Initial preparation 
Initial hiring 


Professional development 
Compensation 

Leadership 

Tenure review or dismissal 


Transfer eligibility or hiring 


Taking Targeted Action to Improve 
Equitable Access to Effective Teachers 


Analyzing data 


Programs to attract or retain effective teachers in 
high-need schools 


Additional hiring support for high-need schools . 


Note: Policies and practices used districtwide or in select schools as of summer 2010 ate shown in this table. 
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ll. Identifying Effective Teachers 


In a recent study of teacher performance measurement practices in 10 districts, researchers found that 
more than 99 percent of teachers were rated as satisfactory. Even where districts offered three or more 
rating categories, more than half the teachers were given the highest rating (e.g., “Outstanding,” 
“Superior’) (Weisburg and others 2009). These ratings became common in part because of 
underinvestment in the systems for measuring teacher performance. These systems traditionally relied on 
classroom observations by building administrators, conducted no more than three times in one year 
(Danielson and McGreal 2000; Porter, Youngs and Odden 2001). Weaknesses in those systems included 
observation instruments based on outdated research on what instruction should look like, lack of 
observer training on the observation instrument, lack of observer expertise in specific assignment areas 
and lack of time for observers to fulfill their responsibilities (Consortium for Policy Research in 
Education 1998; Danielson and McGreal 2000; Weiss and Weiss 1998). 


Districts are now reconsidering the way they measure teacher performance, in part because studies of 
teacher-linked student achievement data indicate sizable differences in teacher performance. For 
example, Gordon, Kane, and Staiger (2006) found that the achievement of students who had teachers in 
the top quartile of effectiveness, as measured by student achievement growth, gained 10 percentile points 
in achievement relative to similar students who had teachers in the bottom quartile. These findings 
underscore the need to better measure differences in teacher performance, as discussed in this chapter, 
and to build such information into district human resource and equity policies, as discussed in chapters 
Il] and IV. 


Using student achievement 


etowth, rather than only The Teacher Advancement Program (TAP) 

observations, to measure The goal of the Teacher Advancement Program is to attract and 
differences in teacher retain talented teachers through a reform model aimed at increasing 
performance has become the rewards of being a teacher. TAP provides professional 
increasingly feasible with the | development, opportunities for collaboration, classroom evaluations, 
availability of teacher-linked and opportunities for career advancement. TAP is based on four 
student achievement data. elements: 

Because many teachers teach 

grades or subjects that are Multiple career paths that allow teachers to take on greater 
currently untested, and responsibilities without leaving the classroom 


because methodological 
issues concerning student 
growth measures remain to 
be resolved (e.g., Koedel and Instructionally focused accountability based on the TAP 
Betts 2009), many states and teaching skills, knowledge and responsibility standards 
districts are developing both 
types of teacher 
effectiveness measures: 
those that use student 
achievement growth and 
those that use new or 
revised classroom 
observations. Some 
programs, such as RTT and 
TIF, require the use of multiple measures to determine teacher effectiveness. 


Ongoing applied professional growth based on collaborative 
time and focused on identified needs 


Performance-based compensation based on teachers’ 
performance in the classroom and their students’ academic 
performance 


TAP is operated by the National Institute for Excellence in Teaching. 
The institute works with districts or groups of schools to implement 
TA: Soutce: http://www.talentedteachers.org (May 2010). 
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In the five study districts, data from student achievement growth or observation measures were used. 
Hillsborough County and Hamilton County were in the process of creating effectiveness ratings by 
combining data from multiple measures (see text box below). Meanwhile, Eagle County and Columbus’ 
Teacher Advancement Program (TAP) schools (see text box above) used data from multiple measures to 
awatd bonuses without actually creating an overall effectiveness score based on combined data; that is, 
teachers could earn separate salary increases for observational scores and for student achievement 


erowth (Appendix A-1 and Appendix A-2 describe these calculations in more detail). 


This chapter’s two main sections discuss (1) teacher effectiveness measures that use student achievement 
growth and (2) teacher effectiveness measures that use classroom observations. A final section draws 
from the experiences of the study districts to provide potential lessons for other districts to consider as 
they pursue similar policies. 


Creating an Effectiveness Rating Using Multiple Measures 
in Hillsborough County and Hamilton County 


When AIR visited Hillsborough in summer 2010, the district planned to use its Bill & Melinda Gates Foundation 
Empowering Effective Teachers (EET) grant to create a new system combining a student growth measure and an 
observation measure, weighted at 40 percent and 60 percent, respectively. Both principals and teachers trained as 
observers would conduct classroom observations. The combined scores from these measures would then be divided 
into five categories (one through five), with categories three through five being considered “Effective.” These scores 
would determine where a teacher stood on a career ladder, which in turn would determine his or her compensation. 
Scores would also be used for tenure and in contract renewal decisions, and for determining the professional 
development needs of teachers. 


As a result of Tennessee’s RTT grant, Hamilton County planned, as of summer 2010, to implement a new system to 
combine data and determine an overall effectiveness score for teachers, beginning in 2011-12. Educators would 
receive a rating of one through five for student achievement growth and another rating of one through five for teacher 
practice, on the basis of a qualitative appraisal instrument. These ratings would be combined into a single rating, 
through a system not yet determined during the site visit. 


Measuring Teacher Effectiveness Through Student Achievement 
Growth 


One approach to measuring teacher effectiveness is to analyze teacher-linked student achievement data. 
Each of the five study districts implemented such measures to some degree. In Columbus, for instance, 
individual teachers in science, social studies, reading and mathematics in grades 3 through 8 were eligible 
to receive reports on their students’ growth through the Teachers Connecting Achievement and Progress 
(TCAP) program. Reports for individual teachers compared the actual amount of student growth over 
the course of one school year to the amount predicted by a statistical value-added model (see Exhibit 2). 
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Exhibit 2 
Sample Teacher Effectiveness Scores 


Value-added scores are sometimes expressed as standardized scores, such as from —2 to 2, or —-1 to 1, with 0 as the 
average. A teacher's score can either be greater than 0, less than 0, or not distinguishably different from 0. The 
sample report below from the Columbus TCAP program shows a “Teacher Effect” of —-0.2, meaning that a point 
estimate of the growth for the students of this teacher was less than expected, according to an analysis of average 
growth for students with similar academic and demographic characteristics. On the far right, the report indicates that 
this difference was NDD, or not detectably different, meaning that the difference was not statistically different from 

0 and, therefore, that the teacher’s performance was not measurably different from that of an average teacher. 


School: Middle School B 
Teacher: lvan 

Grade: 6 

Test: State Test 
subject: Reading 


Mean Mean 
Student Score 
| Score ‘tile 


2004 22 200.6 42 


Note: Data in this exhibit are fictional. 
Source: Columbus City Public Schools presentation, ““TCAP—Teachers Connecting Achievement and Progress: 
Teachers In-Service,” April-May 2007. 


The experiences of the study districts in selecting and implementing measures of teacher effectiveness 
based on student achievement data revealed challenges and practices that might inform other districts on 
the following issues: 


e Selecting an analytic method for linking teacher performance to student achievement 
e Using student growth measures for teachers of nontested grades and subjects 


e Linking students to the right teachers 


e Building principal and teacher understanding of measures of teacher effectiveness 


Selecting an Analytic Method 


There are several methods available for calculating teacher effectiveness on the basis of student 
achievement growth. Choosing a specific calculation method involves a number of decisions, including 
the type of analytic method to use, which control variables to include, and the number of years of 
achievement data to include. Data collected from study districts indicate that some districts took the 
following actions when developing and rolling out measures of teacher effectiveness based on growth in 
student achievement data: 


e Developed different measures of teacher effectiveness for different purposes. For 
low-stakes informational and planning purposes, teachers participating in the Teachers 
Connecting Achievement and Progress program (TCAP) in Columbus received reports that 


Identifying Effective Teachers 7 


estimated their relative effectiveness on a continuum (as shown earlier in Exhibit 2). A teacher 
receiving such a report might seek professional development in subject areas in which he or she 
was less effective. For purposes of determining performance incentive payouts, schools 
participating in a different program—Columbus’ Teacher Advancement Program (TAP)—used 
value-added scores produced using a different methodology (an extension of the state’s model). 


e Monitored initial results to inform changes to measures. Hillsborough County officials 
first started using their student growth measure in 2007, to award performance bonuses. They 
made adjustments based on initial results (see Exhibit 3) and as of summer 2010 were planning a 
new calculation method. 


Exhibit 3 
Hillsborough County’s Method for Computing Teacher Effectiveness 


When visited in 2010, the Hillsborough County School District was in the process of transitioning to a 
value-added teacher effectiveness measure. The prior system used a “value table,” whereby each student’s 
pretest and posttest scores were converted into levels between 7 and 5. If a student made greater gains than 
the average gain of other students at the same pretest level, the teacher earned points, and the number of 
points awarded depended on how difficult the gain was to obtain, as determined by the number of students who 
were able to accomplish that gain. For example, as shown in the table below, a student with a pretest level of 

1 and a posttest level of 1 earned 0 points for a teacher, whereas a student with a pretest level of 1 and a 
posttest level of 4 earned a teacher 145 points. The teacher's effectiveness score was the sum of all of the 
points earned by his or her students, divided by the total number of students. 


American History 
Posttest Score 


Pretest Score 2 3 

Low 1 120 
High 1 115 
105 


—100 
—100 
Source: Merit Award Program presentation, Hillsborough County (n.d.). 


Using Student Growth Measures for Teachers of Nontested Subjects 


There are many teachers and other school staff members for whom student growth data are currently 
unavailable, such as teachers of noncore subjects like art or physical education or some teachers of 
students with disabilities. In addition to using nontest data, such as observations, study districts 
employed a number of different strategies to provide effectiveness scores for these teachers:2 


2 One approach to measuring student achievement growth in currently untested grades or subjects that none of the five 
case study districts was implementing, but that has been described elsewhere is teacher-determined “student learning 
objectives.” For example, the Austin Independent School District uses student learning objectives in which teachers set 
goals for themselves and their students and then measure whether or not those goals are achieved, using assessments 
agreed on with the principal. These could include standardized assessments or teacher-made assessments. The state of 
Rhode Island is considering a similar model. According to Goe (2011), this method allows teachers to have a major role 
in determining how growth is measured and how they will be evaluated. However the method also relies on teachers’ 
judgments; thus, it may be difficult to establish comparability across teachers. 
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e Assigned aggregate scores to individual teachers. One approach several study districts used 
for teachers without assessment data suitable for computing student achievement growth was to 
assign grade-level, department-level or building-level scores to those teachers. In Columbus’ 
TAP schools, where value-added results affected compensation, teachers of nontested subjects 
or grade levels were given a value-added score based on the buildingwide average. Houston used 
a similar approach. One drawback, as one principal in Columbus commented, was that some 
teachers believed it was unfair for some teachers to benefit (or not) from the work of others. 


e Created new assessments. Hillsborough used a different approach for assessing teachers of 
noncore subjects: creating assessments in these subjects and determining student growth, using a 
combination of data from these tests and state assessments in other subjects. For example, a 
score for a social studies teacher might be based on the results of a district-created social studies 
exam, along with a reading score from the state test. However, one principal noted that 
introducing new assessments could raise new issues related to the perceived rigor and fairness of 
the assessments, and might be costly. 


e Repurposed existing assessments. Columbus’ Performance Advancement System (PAS) 
evaluated teachers without classroom value-added reports on the basis of their students’ pretest 
and posttest gains, using other existing district-administered assessments. These assessments 
included end-of-course assessments, benchmark assessments, alternative assessments, and 
assessments of English-language proficiency (see Exhibit 4 for a description of what tests were 
used in the PAS program, and Appendix A—3 for the calculation in detail). 


Exhibit 4 
Tests Used for Columbus Performance Advancement System 


The PAS program allowed teachers in Columbus to engage in classroom action research using a variety of 
assessments to measure student progress, including state achievement tests, district end-of-course (EOC) tests or 
benchmark tests, alternative tests and English-language-proficiency tests. On the basis of the results of these 


assessments, teachers could receive awards of as much as $2,500. 


Possible Pretests for 2009-10 School Year 


Possible Posttests for 2009-10 School Year 


Grades 9-12 


Grades 9-12 


Ohio Achievement Test (OAT) 2009 in reading, 
mathematics, science or social studies for 9th grade 


OAT 2010 in reading, mathematics, science or social 
studies for 9th grade 


EOC 2009 in reading, mathematics, science or social 
studies for 10th or 12th grade 


EOC 2010 in reading, mathematics, science or social 
studies for 10th or 12th grade 


Ohio Graduation Test (OGT) 2009 in reading, 
mathematics, science or social studies for 11th grade 


Alternate Assessment 2009 for special education 


OGT 2010 in reading, mathematics, science or social 
studies for 11th grade 


Alternate Assessment 2010 for special education 


Ohio Test of English Language Acquisition (OTELA) 
2009 for all grades limited English proficient (LEP) 


Ohio Test of English Language Acquisition (OTELA) 
2010 for all grades limited English proficient (LEP) 


Pre-K to Grade 8 


Pre-K to Grade 8 


Get It, Got It, Go—Fall 


Get It, Got It, Go—Spring 


Pre-K Benchmark—Fall 


Pre-K Benchmark—Spring 


Kindergarten Reading or Mathematics Benchmark—Fall 


Kindergarten Reading or Mathematics Benchmark— 
Spring 


OAT 2009 in reading and mathematics for 4th—8th 
grades 


OAT 2010 in reading and mathematics for 4th—8th 
grades 


Alternate Assessment 2009 


Alternate Assessment 2010 


OTELA 2009 for all grades LEP 


OTELA 2010 for all grades LEP 


Source: Performance Advancement System (PAS) 2009-10 Guidelines, http://www.columbus.k12.oh.us/pas. 
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Linking Students to the Right Teachers 


Some of the interviewees in case study districts noted that linking students to the right teachers could be 
especially difficult for students with more than one teacher for the same subject (as in the case of 
coteachers) or for those who worked with specialists or resource teachers. 


Columbus and Hillsborough addressed this issue by requiring teachers to verify (1) the list of students 
whom they taught in the prescribed time periods and (2) the proportion of time that they spent teaching 
them. (An example of the instructions given to teachers in Columbus appears in the following text box.) 
These districts then assigned weights to the scores for these teachers on the basis of the percentage of 
time that the teachers actually spent teaching students. That is, teachers were only considered responsible 
for some proportion of students’ scores. 


Linking Students to the Right Teachers in Columbus 
Prior to calculating value-added scores, the Columbus district asked teachers to verify their student rosters in order to 
properly account for shared teaching responsibilities. Teachers were provided with the following instructions 
regarding linking students to teachers and had to confirm the students for whom they provided instruction. 
Make sure the electronically provided class roster accurately reflects the students you taught. 
Make sure students who moved in or out of your classroom are accounted for. 


Make sure that, if the instruction of some students was shared with another teacher, those students are 
accounted for. 


Source: Columbus City Public Schools presentation, ““T'CAP—Teachers Connecting Achievement and Progress: 
Teachers In-Service,” April-May 2007. 


Building Principal and Teacher Understanding of Measures of Teacher 
Effectiveness 


Staff in two of the five districts underscored the need to develop a comprehensive long-term training 
and communication plan about teacher effectiveness measures, specifying the type of information 
provided, when, how, and to whom. Study districts indicated that they had taken the following actions— 
or were in the process of taking action—in order to build understanding of the teacher effectiveness 
measutes: 


e Provided as much explanatory information as possible about how scores were generated. 
All study districts provided written descriptions of the way their measures of teacher 
effectiveness were generated. In response to questions from teachers in Hillsborough, the district 
showed specifically how many points on the value table teachers received for each of their 
students, so that they could better understand how the overall score was generated (as shown 
earlier, in Exhibit 3). 


e Provided information directly to teachers. Several principals in the districts indicated that 
they did not fully understand how the measures yielded effectiveness scores, and that they could 
not explain the system to teachers. 


At the request of principals, Houston provided information directly to teachers through an 
information portal, to ensure that there were consistent and accurate explanations available (see 
Exhibit 5 for a page from the portal, which contained links to value-added reports, information 
about value-added scores and other information). The portal was designed not only to assist 
teachers directly but to provide more information to principals about the measures. 
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e Provided information in multiple formats. Houston’s portal included videos, online courses, 
brochures, and direct access to data. Columbus provided direct professional development for 
principals and lead teachers (see sample materials used in professional development in 
Appendix A—4). 


Exhibit 5 
Houston’s Web Portal 
Houston’s Accelerating Student Progress—Increasing Results & Expectations (ASPIRE) project portal is designed to 
improve communication about effectiveness measures. It includes links to value-added score reports, information on 
what value-added is and how it is computed, links to professional development courses that teachers can sign up for 
and other relevant information 


ASI? | IRE The Next Generation 
cee «ASPIRE 


Houston independent School District 
Home ASPIRE Value-Added Support Recognize Partner My ASPIRE 


Value-Added Reports Whatis Value Added? Progress Vs. Achievement Benefits FAQs Learning 


Value-Added > Value-Added Reports 


Value-Added Reports 
Access 


A key component of the ASPIRE model is using high-quality data sources, particularly ‘e Learning 
value-added analysis, to guide instructional decision-making. ASPIRE reflects HISD'’s 

continuing commitment to improve teaching and learning so that all students can reach their Free for HISD 
highest potential and receive high-quality education. employees. Go. 


HISD Administrators and Educators: Access to the 2010 District, School, and 
Teacher Value-Added Reports is now available. Log in to My ASPIRE. Under the “My 
Value-Added Reports” section, click on the SAS EVAAS® Login link. 


| accelerate student 
progress because I... 


HISD Families and Community: As of October 1, public access to our 2010 District Provide technical support 


and School Value-Added Reports, as well as the Value-Added Summary Reports, will to schools and 


be available. Click here to access these reports. departments regarding the 
tracking and safeguarding 


of their fixed assets which 
helps secure resources for 
student learning. 


To learn more, download the ASPIRE Guide for Parents & Families Ss 


-Controller 


Share your statement. 


Increasing 
Go. 


Results & 
Expectations 


ASPIRE 


With value-added information, HISD has a more comprehensive picture of student growth 
over time, and a better understanding about how HISD's curriculum and instruction are 
helping students make academic progress. 


Copyright © 2007 - 2011, Houston Independent School District, Battelle for Kids. 


Source: http://portal.battelleforkids.org/ Aspire / Value-Added/VAResults.html?sflane=en, cited 2010. 
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Measuring Teacher Effectiveness Through Classroom Observation 
Methods 


In addition to student growth, the study districts measured teacher effectiveness through observation 
methods. In some of the case study districts, the results of the observations provided a basis for 
immediate, specific feedback to teachers (see Exhibit 6 for a description of the observation framework 
planned for use in Hamilton County as of summer 2010, with explanations of the performance levels 
associated with each measured dimension of teaching). 


Exhibit 6 
Description of Hamilton County’s Planned Measure of Teacher Practice 


Hamilton County’s new classroom observation system was based on a rubric developed by an education consultant. 
The rubric contained the following six domains: 


— Planning and preparation for learning 
— Classroom management 

— Delivery of instruction 

— Monitoring, assessment and followup 


— Family and community outreach 


— Professional responsibilities 


Within each domain, there are 10 indicators. Each indicator has descriptors for four levels of performance. A sample 
indicator (“Knowledge”) and descriptors are shown for the “Planning and preparation for learning” domain. 


Planning and Preparation 


Improvement Does Not Meet 
Highly Effective Effective Necessary Standards 


Knowledge Is expert in the Knows the content Is somewhat familiar | Has little familiarity 
content area and well and has a good | withthe content and | with the content and 
has cutting-edge grasp of how has a few ideas of few ideas on how to 
grasp of how students learn ways students teach it and how 
students learn develop and learn students learn 


Teachers would earn between 1 and 4 points per indicator (1 for “Does Not Meet Standards,” 2 for “Improvement 
Necessary,” and so on). Data were to be collected through 10 “mini observations” (5-10 minutes) by principals and 
assistant principals, as well as document reviews. For the summative evaluation, principals would total the points 
earned for each indicator. For example, a teacher who earned an “Effective” rating for 60 indicators would earn a total 
of 180 points (60 indicators x 3 points per indicator), giving him or her a final rating for the year of “Effective.” Along 
with the score, comments and specific examples were to be provided to the teacher. 


continued next page 
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Exhibit 6 (continued) 
Description of Hamilton County’s Planned Measure of Teacher Practice 


@® Highly effective *211-240 *Top performer 
*Satisfactory 
evaluation 

® Effective *180-210 *Good standing 


*Satisfactory 
evaluation 


® Improvement °151-179 *PlPinitiated, 


necessary * Unsatisfactory possiblenon- 
evaluation reelection 


@ Does not meet e<151 *T PP/L4P initiated, 
standards *Unsatisfactory possiblenon- 


evaluation reelection 


Note: PIP refers to Performance Improvement Plan; TPP/IAP refers to Teacher Performance Plan/Intensive 
Assistance Plan. 


Source: Hamilton County Teacher Evaluation Pilot, Draft presentation, 2010-11. 


Four of the five study districts used or were planning to use revised teacher observation systems, 
replacing traditional systems. The fifth district, Columbus, supplemented its existing classroom 
observation measure only in its six TAP schools. The experiences of the five study districts in selecting 
and implementing measures of teacher practice can be organized into the following areas: 


e Selecting an observation framework 
e Using effective teachers as observers 
e Ensuring consistency in scoring 

e Scheduling observations 


e Updating the observation framework 


Selecting an Observation Framework 


In choosing an observation framework, districts have to consider several questions (summarized in the 
following text box). At a more general level, districts have to choose between adopting an existing 
framework wholesale, adapting an existing framework or creating an entirely new one. Some existing 
frameworks may have evidence of validity and reliability. By adopting these frameworks, districts or 
states may also benefit from existing training or other support resources. However, districts or states may 
want to allow their staff or teachers to have input into the design of observation rubrics. Columbus 
adopted an existing framework developed for use in all TAP schools. The TAP rubric consists of a 
number of different dimensions related to instruction, planning instruction and the learning 
environment. Teachers receive an overall score of 1 to 5: 1 and 2, not proficient; 3, proficient; and 


4 and 5, advanced. 
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Eagle County started using the TAP observation framework as originally designed but, over time, 
adapted the framework. For example, the county created some indicators that were observed over time 
and some that were scored in the course of a single observation. Hamilton County also took an existing 
framework and made extensive revisions. These districts had not yet determined the predictive validity of 
the resulting frameworks (see Appendixes A—5 to A—7 for the frameworks from study districts). 


Questions to Consider in Selecting an Observation Framework 


Researchers from the University of Virginia suggest the following questions for consideration in selecting an 
observation framework: 


Tier 1: High-Priority Questions 

— What questions about classrooms does my organization want answered? Is the scope of this tool aligned with the 
questions about classrooms and teachers’ practices that we want to address? 

— Are the observation and scoring protocols standardized and clear? 

— Has this tool been shown to be reliable across observers and over time? 


— Are the outputs (scores) from this observation protocol proven to be related to outcomes of interest in our 
population (i.e., growth in students’ academic skills, students’ prosocial behaviors, teacher retention, students’ 
reports of feelings of belongingness, etc.)? 


Tier 2: Additional Considerations 

— Does the system include complementary sources of information (such as student surveys, etc.) that could be used 
to obtain a more complete portrait of the classroom? 

— Does the observation include guidelines and support for using findings for professional development purposes? 


— ls the time required for observation feasible for your organization? 


Source: “A Practitioner’s Guide to Conducting Classroom Observations: What the Research Tells Us About Choosing 
and Using Observational Systems,” by Megan W. Stuhlman, Bridget K. Hamre, Jason T. Downer, and Robert 
C. Pianta, University of Virginia, 2010. 


Using Effective Teachers as Observers 


Some districts used effective teachers as observers in their evaluation systems. There are both benefits 
and drawbacks to this approach. Effective teachers may have credibility among teachers and 
administrators. However, a drawback is taking effective teachers out of the classroom. Also, conducting 
observations may involve skills (e.g., providing constructive feedback to adults, communicating with 
adults) that are not the same as those that make a teacher effective in the classroom. Finally, teachers 
who are effective in one subject or at one grade level may not have the content background to effectively 
observe teachers of other subjects or grades. Especially at the high school level, teachers being observed 
may be concerned that observers do not have sufficient understanding of the academic material to be 
able to accurately interpret lessons and provide valid and useful feedback. To respond to these concerns, 
study districts took the following actions: 


e Created time-limited positions, so that effective teachers were not permanently out of the 
classroom. Hillsborough County debated this issue and concluded that using effective teachers 
as observers or evaluators benefits many teachers and students. However, the district limited 
observers’ positions to two-year appointments, so that teachers could return to the classroom 
after serving as observers. 
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Developed selection criteria for observers that went beyond effectiveness. Several Eagle 
County principals and district officials spoke about how the process of hiring master and mentor 
teachers who serve as observers had become more selective over time as they focused not just 
on effectiveness but also on a teachet’s ability to work with other teachers. 


Used school-based observers. In Eagle County and in Columbus TAP schools, master and 
mentor teachers were school based, and one principal spoke about the benefits and challenges of 
having a former teacher in the school become a master or mentor teacher. On the one hand, 
such a teacher could have a strong reputation as an effective teacher and good personal 
relationships with teachers; on the other hand, these same relationships could result in concerns 
about objectivity. Having school-based observers could also reduce the possibility of having 
observers with specialized content knowledge, because schools could only select a few observers 
and might have many different types of courses taught by different teachers. 


Assigned observers by subject area. As of summer 2010, Hillsborough planned to try to 
assign observers by subject area, matching as many as possible. Teacher observers would be 
assigned to a number of schools and observe teachers in a particular grade level or content area 
across schools. 


Ensuring Consistency in Scoring 


A major issue in the implementation of classroom observation frameworks is ensuring consistency and 
reliability in scoring, particularly for rubrics with many indicators. To address this challenge, the 
five districts took the following actions (or were considering these actions): 


Provided training materials, such as handbooks or other reference materials, to 
observers. Eagle County’s professional development department created a handbook to go 
along with its observation rubric. This handbook included detailed information about the rubric 
indicators and examples. The district also provided online training modules for schools. 


Required ongoing training and certification. Eagle County reported that it required anyone 
who would conduct observations to be recertified each year. Those certified in the past attended 
a two-day refresher training and took another exam. New observers had a two-day training 
before the school year started, and then made live observations with a trained evaluator and 
returned six to eight weeks after school started for two final days of training and a final exam. 
Anyone who did not pass the exam would go through additional training. 


Monitored scores within and across schools. Two districts analyzed scores across schools to 
look for potential inconsistencies or patterns. One Eagle County principal mentioned that, in 
past years, the district analyzed building rubric scores compared with district averages, to look 
for outliers. The same principal had principals spend time in one another’s buildings to create 
shared understanding of scores. In Columbus, one principal scheduled initial observations with 
multiple observers as often as possible, so that they could calibrate their scoring within the 
school. 
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Scheduling Observations 


Once an observation framework has been selected and observers selected and trained, these observers 
must find time to complete all the required observations. Particularly in large schools, simply scheduling 
and completing observations can be difficult. Study districts reported a number of strategies to address 
these issues: 


e Developed observation systems that involved a feasible number of observations. In 
Hamilton County’s new observation system, which was being piloted at the time of data 
collection in summer 2010, the plan was to have administrators observe each teacher, using 10 
mini-observations of approximately 5 to 10 minutes each. The observations were not to include 
preconferencing. Feedback was to be provided to the teacher in a short conversation, which was 
to last approximately 5 to 10 minutes. While this system required many observations for each 
teacher, each observation was to be very short in duration. Other study districts required fewer 
observations, with each observation lasting longer. For instance, Eagle County required three 
formal class-length observations, and more were encouraged. Researchers at the University of 
Virginia, who support the implementation of the Classroom Assessment Scoring System 
(CLASS) observation instrument, have determined that four observations are needed to ensure 
reliability in their system (Pianta, La Paro and Hamre 2007). 


e Provided specific supports for observers, to help them make time for the observation 
work. Hamilton County provided guidance to help administrators plan their observation 
responsibilities (see Exhibit 7). Because the district required many short observations of each 
teacher, administrators needed to complete approximately two teacher observations per day, 
throughout the year. To provide more time for principals to conduct observations and work 
with teachers, Houston was working on having the district central office take on some 
administrative tasks formerly provided at the school level (e.g., processing payments for 
professional development). 


e Established guidelines for the timing of observations. Eagle County’s system, which 
included both teacher and principal observers, purposely scheduled principal observations for 
the second half of the school year. This schedule allowed teachers to get feedback from peers 
and work on their practice before having a principal, whose scoring counted more heavily in a 
teacher’s summative evaluation, conduct his or her observation. In addition, observations did 
not begin until several weeks into the school year. 
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Exhibit 7 
Hamilton County’s Guidance on Conducting Observations 


Hamilton County’s communication to principals included general guidance on ways to schedule observations, as well 
as specific scenarios for different numbers of teachers and administrators, so that they could be completed as 
required. 


Teachers observed Average number 
Number of : g 
(at 10 : Ie PE WEE-\ lilo) (mies of observations 
, Total observations Administrators : 
observations per Gene observing per day, per 
(Principals + APs) aie 
teacher) administrator 


* 90 teachers * 900 observations ~—sx. 4 administrators * 120 days * 1.9 / day 
* 60 teachers * 600 observations ¢ 3 administrators * 120 days * 1.7/ day 
* 36 teachers * 360 observations — + 2 administrators e 120 days ° 1.5 /day 


* 30 teachers * 300 observations ~—« 1 administrator ¢ 120 days 


Source: Hamilton County Teacher Evaluation Pilot, Draft presentation, 2010-11. 


Updating the Observation Framework 


As classroom observation frameworks are implemented widely, teachers and principals may discover 
problems or areas that should be modified. Each of the case study districts reported at least one of the 
following strategies for identifying ways that the observation framework might need to be updated or 
revised: 


e Collected feedback regularly from all stakeholders. Houston district officials recently 
conducted a survey of all principals and teachers to gather feedback on the observation tools in 
use in the district. Thirty-eight percent of high school teachers and 48 percent of elementary 
school teachers believed that the framework allowed appraisers to assess their instructional 
performance accurately (see Exhibit 8). About two-thirds of teachers reported that their 
confidence in the performance appraisal system would increase if it addressed factors such as 
clear timelines for the process, clear standards for observation and appraisal, ongoing surveys to 
seek input on the system, professional development based on the system, and training and 
evaluation of appraisers. At the time of data collection, Houston was considering adopting a new 
observation framework. 


e Instituted regular updates. One study district, Eagle County, built a requirement into its 
policies that a committee review the district’s framework and its implementation every two years 
(see the text box, pg. 20, for the language of this requirement in Eagle County policy). A 
committee of principals, teachers, and union and district staff was to conduct the reviews. 
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Exhibit 8 
Results of Houston’s Survey on the Classroom Observation Framework 


A 2010 study by the New Teacher Project, in partnership with the Houston Independent School District, found little confidence in the statewide rubric used in 
Houston—the Professional Development and Appraisal System (PDAS) or a Modified PDAS (MPDAS), used with senior teachers. 


G@ 


According to teachers, current appraisal tools do an especially poor 
job assessing performance at the secondary level. 


Teachers Agreeing that PDAS Allows Appraisers to Accurately Assess 
Instructional Performance, by School Level 


Elementary Middle 


Source: Surveys of HISD teachers. Percentages indicate respondents who selected “Strongly agree” or “ Agree”. 
© The New Teacher Project 2010 


Source: Presentation to the Houston Independent School District Board of Education, “Core Initiative Update: Effective Teacher in Every Classroom,” June 3, 
2010. 


continued next page 
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Results of Houston’s Survey on the Classroom Observation Framework 


Exhibit 8 (continued) 


G Principals share teachers’ concerns about the district’s current 


appraisal systems. 


of principals say that 
problems with the 
PDAS/MPDAS tools are a 
significant barrier to 
providing effective 
appraisal of instructional 
performance. 


of principals say that 
PDAS/MPDAS allows 
them to accurately assess 
teachers’ instructional 
performance. 


Source: Surveys of HISD principals. Percentages indicate respondents who selected “Strongly agree” or “Agree”. 


© The New Teacher Project 2010 


Source: Presentation to the Houston Independent School District Board of Education, “Core Initiative Update: Effective Teacher in Every Classroom,” June 3, 
2010. 
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Eagle County’s Policy on Reviewing the Observation Framework and Its Use 


Eagle County had a written policy that it would review its evaluation system every two years and make changes if 
necessary. 


The Board of Education shall appoint an advisory school Personnel Performance Evaluation Council, which shall 
have the purpose of assisting in the district’s compliance with state law regarding licensed staff evaluations. This 
council will not evaluate the performance of employees, but rather will review the evaluation system a minimum of 
once every two years to determine if, in its judgment, the system meets the intent of state legislation and to provide 
appropriate recommendations to the Board and Superintendent as to any needed improvements. The licensed staff 
members will be provided the opportunity to submit recommendations regarding the refinement or improvement of the 
evaluation system. 


Source: Eagle County Schools administrative policies, 2010. 


Summary 


The five study districts developed measures of teacher effectiveness that drew on data on student 
achievement growth and classroom practice. While their reasons for developing these measures varied, in 
four of the five districts compensation reform was a key driver. Specifically, Columbus, Eagle County, 
Hillsborough and Houston all developed or improved their measures of teacher effectiveness in order to 
offer performance incentives for high-performing teachers districtwide or in select schools. In summer 
2010, Hamilton County, Columbus, and Hillsborough were planning to continue their work to develop 
and refine measures of teacher effectiveness as part of their states’ RTT grant efforts. All the districts’ 
efforts to date suggest some inherent challenges that other districts and states may need to address as 
they consider developing measures of teacher effectiveness: 


e Communication and engagement. Interviewees noted that efforts were needed to ensure that 
teachers and principals were appropriately informed about new measures of teacher 
effectiveness. Whether with respect to the design of a new measure or to its implementation, 
study districts responded to the need to allow for input and to provide clear and comprehensive 
information to teachers, principals and other stakeholders in a variety of ways. Some provided 
opportunities for teachers or others to help develop or refine measures like classroom 
observation frameworks. Others focused on providing information about their measures. 

One provided a systematic, ongoing process by mandating regular stakeholder input for updates 
to the teacher evaluation process. 


e Limited scope of student achievement growth measures. A key challenge for study districts 
was that data on student achievement growth data were available only for teachers in grades and 
subjects in which state tests were implemented. Study districts used different approaches to 
supplement these measures, including creating or repurposing other district assessments, or 
applying schoolwide or other aggregate measures to teachers in untested grades or subjects. 


e Implementation of classroom observation frameworks. Interviewees noted challenges in 
implementing classroom observation systems that were both rigorous and feasible. For example, 
interviewees noted challenges in finding the right observers, and in ensuring and maintaining 
reliability. Study districts took a variety of approaches in response to these challenges, including 
providing scheduling support, providing ongoing training, and working with teachers and 
principals to identify the right observers for each district’s context. 
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lil. Using Information About Teachers’ Effectiveness 
in Human Resource Policies 


Human resource policies, such as teacher hiring, professional development, retention and dismissal, are 
important levers in efforts to ensure that all students have effective teachers (Odden and Kelly 2008). 
The absence of meaningful information on teacher effectiveness can hamper the development of human 
resource policies. For example, many teacher professional development activities are typically designed 
to be “one size fits all,” rather than tailored to teachers’ individual strengths and weaknesses (Weisberg 
and others 2009). 


With information about teachers’ effectiveness available, districts have opportunities to use that 
information to design human resource policies. This chapter illustrates several approaches to using such 
information, including those that treat teachers differentially on the basis of effectiveness information, as 
well as those that apply to districtwide practices, such as hiring. Chapter IV addresses approaches to 
using effectiveness information to more equitably distribute effective teachers among schools. The five 
study districts used specific strategies in three areas to improve teacher effectiveness: 


e Preparing and hiring effective new teachers 
e Improving the effectiveness of current teachers (e.g., professional development) 


e Retaining effective teachers and removing ineffective teachers 


These strategies are discussed in the sections that follow. A summary of the types of policies in use in 
study districts is provided at the end of this chapter. 


Preparing and Hiring Effective New Teachers 


One way to improve teacher effectiveness is to ensure that new teachers are well prepared and that 
hiring practices include appropriate selection criteria. Some of the study districts used information on 
teacher effectiveness to inform efforts to hire new teachers, specifically by developing the supply of 
applicants and by refining the criteria for selecting applicants. This section addresses these two practices 
in turn: 


e Providing input on the design of teacher preparation programs 


e Using effectiveness information to refine new-hire selection criteria 


Providing Input on the Design of Teacher Preparation Programs 


One way to improve the quality of new hires is to provide input into the design of teacher preparation 
programs, on the basis of the performance of recent hires. As part of a federal Teacher Quality 
Partnership grant, Columbus City Schools and a higher education partner, the Ohio State University 
(OSU), established a strong working relationship in which the district was represented in conversations 
regarding changes to OSU’s preparation programs. Representatives from the district’s mentoring 
program for first-year teachers were members of the committee that discussed changes to OSU’s 
program. The district used input from the mentoring program representatives on areas in which current 
first-year teachers struggled to guide changes to preparation programs. 
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Another feature of the partnership between Columbus and OSU was a model teacher residency 
program. The teacher residency program provided each preservice student teacher with a current 
Columbus district teacher to serve as a mentor, and with improved field experiences so that student 
teachers would be better prepared for urban teaching. 


Using Effectiveness Information to Refine the Selection Criteria for Hiring 


One factor that may affect the quality of new hires is a district’s selection criteria. To date, there is little 
research to support the use of specific tools or strategies to identify applicants who may be effective 
teachers. Research that does exist suggests modest relationships between selection instruments, such as 
attitudinal surveys, and teacher effectiveness (e.g., Rockoff and others 2008; Novotny 2009; Metzger and 
Wu 2008). 


In the absence of more research, one way districts can refine their selection criteria is by analyzing the 
relationship between first-year teachers’ effectiveness and their prior scores on hiring selection 
instruments. Houston developed a plan to measure the percentage of screened applicants who were 
found to be effective, as shown in the following text box. An annual report will provide “detailed 
analysis and proposed action related to the key metrics for recruitment and selection.” 


Houston’s selection process had a four-stage selection pipeline that screened applicants on the basis of 
paper qualifications, a 5-minute sample of teaching, a 30-minute structured interview and then a final 
review by committee. The 30-minute interview used the Haberman Educational Foundation’s (HEF’s) 
Star Teacher Pre-Screener, which assesses applicant values and attitudes believed to be associated with 
successful teaching of high-need students. 
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Sample Houston Metrics to Monitor Hiring Efforts 


Houston developed a strategic plan to develop an effective teaching force, which included goals and metrics to 
monitor progress. This excerpt from that plan shows the overall goal, some key metrics and reporting requirements 
related to hiring. Note that EVAAS stands for “Education Value-Added Assessment System,” a commercially 
available system for measuring teacher effectiveness, using student growth, and that the “screener” is the Haberman 
Education Foundation’s Star Teacher Pre-Screener. 


Attract and hire top talent through proactive search strategies and rigorous selection criteria for every job position. 
KEY METRICS 
Recruitment and Selection 


Number of new teacher hires 
% of teacher applicants rated in the acceptable range on screener 
% of principal applicants rated in the acceptable range on screener 
% of Human Resources-screened teachers rated in top 10% of EVAAS value-added data 
% of Human Resources-—screened teachers rated in top two quartiles of EVAAS value-added data 
Teacher yield %: # of offers made to teachers versus # of teachers that accepted offer 
Report: The administration will report to the Board of Education on the outcomes of the recruitment season, including 


comprehensive analysis of the efficacy of recruitment efforts. The report will include detailed analysis and proposed 
action related to the key metrics for recruitment and selection. 


Source: Houston Independent School District Board of Education Board Monitoring System 2009-10. 
http:/ /www.houstonisd.org/HISDConnectEnglish/Home/Board%200f%20Education/Board%20Images/Ne 
w%20BMS%20Document-Final%20Rev2.pdf. 


Improving the Effectiveness of Current Teachers 


After teachers have been hired, districts have a variety of opportunities to support teachers’ growth and 
improve their effectiveness, and most districts offer a range of teacher professional development 
opportunities. 


This section describes three approaches used in the study districts to increase the effectiveness of current 
teachers: 

e Using observations to provide teachers with frequent feedback 

e Using effectiveness information to create professional development plans for individual teachers 


e Using effectiveness information to plan district professional development 


Using Observations to Provide Teachers With Frequent Feedback 


The study districts with new or revised observation systems used feedback (or planned to use feedback) 
from the observations as a key part of professional development for teachers. For example, in Hamilton 
County, teachers were to receive brief feedback within 48 hours after each of the 10 mini-observations 
occurring during the course of the year (see Exhibit 9). 


Such feedback occurred multiple times, ranging from 3 to 10 times, during the course of the school year 
in the study districts, providing teachers with “job embedded” opportunities to improve their practice. In 
research on the link between professional development and teacher practice, this feature correlates with 
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changes in practice (e.g., Garet and others 2001). In fact, in Eagle County, where a system of frequent 
feedback had been in place since 2001, district officials reported survey results showing that 80 percent 
of teachers said that they were better teachers because of the rubric and the associated feedback. 


Frequent feedback can be used as part of a general improvement strategy for all teachers but can also 
focus on teachers who may have been identified as in need of assistance, using other effectiveness 
information. Columbus’ intensive Peer Assistance and Review (PAR) program supported teachers who 
were struggling by providing a dedicated mentor, called a consulting teacher, to observe lessons and 
provide immediate feedback. Teachers could potentially be observed up to 40 times, according to the 
district. 


Exhibit 9 
Hamilton County’s Proposed Cycle of Feedback to Improve Teacher Effectiveness 


Hamilton County’s evaluation measure would allow for a year-long process of observation, feedback and professional 
development guidance and goal setting. 


Recommended Required Required 


Assessment a: : Summative 
Mini-Observations : 
Conference Evaluation 


eTeacher ©10 mini- Based on mini- 
completes a self- observations observations and 


assessment seine ta tid supplemental data 


¢Principal reviews sentences of eEach indicator is 
teacher-level data feedback is scored 
and prior recorded 


- ¢Clarification and 
evaluations 


Feedback given rationale for 
¢Discussion within 48 hours ratings is 
centered on discussed if 
expectations requested 


eGuides PD growth 
plan for teacher 


Source: Hamilton County Teacher Evaluation Pilot, draft presentation, 2010-11. 


Using Effectiveness Information to Create Professional Development Plans 
for Individual Teachers 


Effectiveness information can also be used to develop long-term professional development plans for 
individual teachers. The system in Hamilton County (described in Exhibit 9) would take into account 
both student growth and observation data to guide plans for individual teachers. Houston’s staffing 
review process (see the following text box) was intended to help principals use data on teacher 
effectiveness to develop individualized plans for teacher support and professional development. The 
process involved district-level professional development staff in conversations with principals, to assist 
them in creating these plans, using available data on teacher effectiveness. 
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Description of Houston’s Staffing Review Process 


In spring 2010, principals in Houston began to use teacher performance information to develop individual plans for 
teacher recognition and professional development. Through the staffing review process, principals placed teachers in 
one of four performance categories and then met with district human resources and professional development 
representatives to create plans for each teacher. For example, for veteran teachers in the lower two categories, 
principals developed remediation plans, including strategies such as team teaching, mentoring and professional 
development (see Appendix A-8 for the decision-making framework used by principals). An excerpt from a district 
memo describing the staffing review process is shown here: 


The purpose of this process is to ensure that teachers receive recognition for their excellent work, targeted 
professional development to meet their needs and important feedback regarding their performance. Principals should 
implement this staff review process for all teachers on their campus. 


Step One: Categorize/group your teachers. 


Principals should group all of his/her teachers in one of the following four categories. Decisions should be based on 
effectiveness by using all performance data, including but not limited to, principal walkthroughs, classroom 
observations, review of student work products, formative student assessment data and value-added scores, 

when available. 


Highly Effective—teachers who consistently achieve student academic growth and/or student academic 
outcomes that are better than expected, based on value-added or other student performance data 


Proficient—teachers who achieve expected levels of student academic growth and/or expected student 
academic outcomes, based on value-added or other student performance data 


Developing—teachers who show potential for improvement but who achieve student academic growth and/or 
student academic outcomes that are less than expected and who may need additional supports to improve their 
instructional practices, based on value-added data or other student performance data 


Low-Performing—teachers who consistently achieve low levels of student academic growth and/or student 
academic outcomes that are significantly less than expected, based on value-added or other student performance 
data 


Step Two: Attend a staff review meeting to be scheduled by Academic Services. 
Academic Services will be scheduling sessions with principals to conduct the staff review process. In preparation for 


these meetings, principals should be prepared with information on your staff and have completed Step 1 of this 
process. In addition, you should be considering career development strategies for teachers in each group. 


Source: Houston Independent School District Memo from superintendent on staffing review process, March 5, 2010. 


Using Effectiveness Information to Plan District Professional Development 


In addition to planning professional development for individuals, some study districts also used 
effectiveness information to inform professional development practices more generally. In Houston, a 
group of teachers who were rated “highly effective” on the basis of student achievement growth 
developed a set of recommendations for principals and teachers. As of summer 2010, Eagle County 
planned to collect instructional materials from teachers identified as “excellent” through Eagle County’s 
“Excellence in Teaching” process (modeled after National Board Certification process) as models. 


Aggregate analysis of effectiveness information pooled across the district may also inform professional 
development practices. In discussions about teacher professional development in Hamilton County, the 
district decided that data from each of the brief observations that principals conducted would be 
electronically saved in the district’s data system, and information about the needs of teachers would be 
shared with content specialists in the district, who could then plan for professional development. 
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Retaining Effective Teachers and Removing Ineffective Teachers 


Once a system has been designed to identify effective teachers, districts need strategies to retain them. 
These strategies can include performance-based compensation or bonuses and leadership opportunities. 
Conversely, once teachers are identified as ineffective, and if strategies to help them improve are 
unsuccessful, districts may wish to consider dismissal. As part of its strategic plan, Houston developed 
key mettics to monitor its efforts to retain and remove teachers on the basis of their effectiveness, as 
shown in the text box. 


Houston’s Sample Metrics to Monitor Progress in Using Effectiveness Information for 
Retention and Termination Decisions 


Houston developed a number of key metrics that draw on teacher effectiveness information to track the district’s 
progress in retention and termination. 


Critical Outcome: Human Capital Assessment and Retention 


Provide every employee ongoing and annual feedback that creates opportunities for recognizing excellence and 
developing skills and leadership, and retains high-performing staff in every job position. 


KEY METRICS 
Human Capital Assessment and Retention 


% of probationary teachers who receive a term contract 

% teachers in the top 10% of EVAAS value-added data who are retained 

% teachers in the top two quartiles of EVAAS value-added data who are retained 

% principals in the top 10% of EVAAS value-added data who are retained 

% principals in the top two quartiles of EVAAS value-added data who are retained 

% of teachers in the top 10% of EVAAS value-added data who are terminated or who retire 

% of teachers in the bottom 10% of EVAAS value-added data who are terminated or who retire 

% of teachers in the bottom two quartiles of EVAAS value-added data who are terminated or who retire 
% of principals in the top 10% of EVAAS value-added data who are terminated or who retire 

% of principals in the bottom 10% of EVAAS value-added data who are terminated or who retire 

% of principals in the bottom two quartiles of EVAAS value-added data who are terminated or who retire 
% of employees on a performance improvement plan by school or department 

% of regressive value-added performers on performance improvement plan 

% of regressive value-added performers on improvement plans who attain positive value-added scores following 


remediation outlined in the plan 


Report: The administration will report to the Board of Education on the outcomes of personnel assessment metrics. 


Notes: EVAAS is the district’s value-added model, the Educator Value-Added Assessment System. 
Regressive value-added refers to teachers with scores of less than 0, using the district’s measure. 


Source: Houston’s Board Monitoring System, updated February 2010. 
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The availability of data on teacher effectiveness creates new opportunities for districts to design policies 
to reward and retain effective teachers and to revisit policies related to teacher tenure and dismissal. This 
section describes four approaches used in the study districts: 


e Using effectiveness information in teacher compensation 
e Using effectiveness information to create new career paths 
e Using effectiveness information in tenure review and dismissal 


e Using effectiveness information in transfer eligibility and transfer hiring decisions 
Using Effectiveness Information in Teacher Compensation 


With the exception of Hamilton County, all the study districts were engaged in a performance pay 
initiative of some kind. Using effectiveness information in compensation systems raises a variety of 
questions about the design and implementation of such systems, including whether or how much of an 
awatd should be based on individual performance, compared with collective performance; whether 
performance-based awards should replace or supplement existing salary or bonus structures; the 
amounts of awards needed to successfully retain teachers; and how to ensure that the system is 
transparent for stakeholders. 


For example, Eagle County’s performance-based compensation system drew on both individual and 
collective measures of effectiveness, and based payments on effectiveness information, as well as 
qualifications (see the following text box). This system was designed in response to concerns raised 
about the effects of individual incentives on teacher collaboration, as well as stakeholder beliefs about 
the utility of qualifications. Several principals mentioned that, especially in certain subjects, they looked 
for teachers with master’s degrees, perceiving this as a sign that the person is likely to be effective. 
Indeed, research suggests that, in certain subjects, qualifications related to content partially predict 
effectiveness (Wayne and Youngs 2003). 
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Description of Eagle County’s Performance-Based Compensation System 


Eagle County’s performance-based compensation system included both yearly incentives and permanent salary 
adjustments based on performance, and replaced a traditional salary schedule. Salary increments for teachers and 
other employees were based on effectiveness, as measured through observations each year. Thus, base salary 
increased each year by a percentage associated with the level of performance (in the example below, a 3 percent 
increase for a “high-performing” evaluation). Bonuses were awarded each year as a percentage of base salary using 
buildingwide and districtwide student achievement growth on the Colorado State Assessment Program (CSAP), 
American College Testing (ACT) and the Northwest Evaluation Association (NWEA) MAP assessment (in the 
example below, a 2.5 percent increase based on these scores). As described in the section on measures of teacher 
effectiveness in chapter Il, study districts employed a variety of methods to try to improve communication about 
measures and their uses for performance pay (see Appendix A—1 for a sample of the letter sent to teachers in Eagle 
County describing the way the performance-based compensation is calculated). The example shown here is an 
abbreviated version presented on the Eagle County website to describe the system to prospective teachers. 


Putting It Together: An Example 


Teacher Joe makes $45,000 as his contract salary. He also adds $3,000 for an advanced degree and $2,500 for 
working in a “high-poverty” school as “a la carte” salary additions. These additions are NOT included as his contract 
salary. They will increase as district needs and market conditions require them to; so we use the $45,000 for 
determining bonus and the next year’s raise. Joe will earn 


— $1,125 bonus from a 2.5% increase based on his assessment index for the district and his school (CSAP, NWEA 
and ACT) 


— $900 salary increase for the Negotiated/Inflationary Component, set for the next year at 2% 
— $1,350 salary increase for Joe’s “High-Performing” evaluation which was 3% 


New annual salary: $47,250 


Source: http://www.eagleschools.net. 


Several principals in study districts mentioned that they did not think their district’s performance 
bonuses were large enough to have a big impact on teacher retention or motivation. Odden and Wallace 
(2007) recommend a range of 4 percent to 8 percent of salary, consistent with a review from private 
sector studies that found a range of 3.5 percent to 11 percent. Bonuses in study districts were in the 
$1,500 to $3,000 range (which with a median teacher salary of about $51,000 across districts would 
represent a range of about 2 to 6 percent), although Eagle County had a temporary “Excellence in 
Teaching” award program, which offered a one-time $10,000 bonus to teachers who applied for the 
program. Research studies conducted to date show mixed results for performance pay on teacher 
retention. A few rigorous studies (e.g., Springer and others 2008; Wiley, Spindler and Subert 2010) find 
increased retention of effective teachers with the use of performance incentives, while others do not 
(e.g., Glazerman and McKie 2010). 


Using Effectiveness Information to Create New Career Paths 


A study by the Center for Teaching Quality found that teachers who held leadership positions were 
significantly more likely to plan to stay in the profession over the next three years (Berry, Daughtrey and 
Wieder 2010). Most study districts offered teachers opportunities to be coaches or mentors. For 
example, master and mentor teachers in Eagle County and Columbus conducted observations and 
provided individualized coaching to teachers. These teachers were selected in part on the basis of their 
effectiveness. Columbus’ TAP program specified that applicants must submit a video of their classroom 
teaching, which would be scored using the TAP observational rubric, “evidence of student 
achievement,” and references designed to gather information about the candidate’s leadership skills, 
among other things. 
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Using Effectiveness Information in Tenure Review and Dismissal 


In addition to better identifying ineffective teachers, some study districts used information about 
effectiveness in their tenure reviews and dismissals. For example, Houston updated its policy on annual 
renewal of the contracts of untenured teachers. A consistent lack of student progress, as measured by the 
value-added formula, was added to the list of reasons for termination of an untenured teacher. The 
revised policy stated, “In accordance with its data-driven culture, the District is including as a reason for 
nonrenewal insufficient student academic growth as reflected by value-added data.” Both Houston and 
Hamilton County district officials discussed changes they had recently made to the period of service 
preceding the district decision to grant tenure, to allow increased attention to teacher effectiveness in 
tenure decisions. 


Two study districts also discussed how they supported principals in teacher dismissal processes. In its 
staffing review process, Houston provided a decision-making document to principals, to assist them in 
considering actions to take for each teacher, including proposing termination (see Exhibit 10 for an 
excerpt from the policy focused on tenured or “term” teachers, and Appendix A-8 for the full 
document). In addition, Houston offered three-day training for principals on how and when to move 
toward termination. According to the district, the staffing review process resulted in an increased 
number of teachers’ not being granted tenure after three years (from 7 in 2009 to 154 in 2010), an 
increased number of teacher contract terminations (from 45 in 2009 to 100 in 2010) and an increased 
number of resignations in lieu of termination (from 24 in 2009 to 61 in 2010). 


Exhibit 10 
Houston’s Staff Management Decision-making Framework Excerpt 


The following excerpt shows how the Houston school district is providing guidance to its principals on how to use 
effectiveness information for termination decisions about teachers (in this case, for “term” or tenured teachers). 


Contract Type Management Decision Framework Options 


Term 1. Contract should continue if: 
— Teacher performance meets or is above expected levels 


¢ But if a teacher has a Running Cumulative Average that is regressive (i.e., less than 0) 
in any one subject, a growth plan is required (i.e., team-teaching, mentoring, 
professional development) 


— There is no other compelling reason to terminate the contract 


2. Termination should be proposed if: 


— Unsatisfactory performance on one or more of the 34 criteria as part of the district’s 
evaluation system for teachers. 


Source: Houston Independent School District Memo from superintendent on staffing review process, March 5, 2010. 


Eagle County encouraged its principals to make additional efforts to gather and review data on the 
effectiveness of untenured teachers, who could be dismissed through nonrenewal. On average, over the 
last few years, the annual rate of nonrenewal for probationary teachers was 20 percent. By comparison, 
the rate of nonrenewal in six case study districts in a recent study was less than 1 percent in five districts 
and 3 percent in the sixth district (Denver Public Schools) (Weisberg and others 2009). 
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Using Effectiveness Information in Transfer Eligibility and Transfer Hiring 
Decisions 


Some of the study districts used effectiveness information in the rules governing transfers from one 
school to another. Such rules vary by district and usually take into account teacher preferences. These 
rules may be important places to insert effectiveness criteria, if teachers rated as unsatisfactory by their 
principals transfer to a school where the principal may be more lenient, or principals who are unwilling 
or unable to dismiss ineffective teachers may encourage them to transfer. 


Houston tightened its transfer eligibility criteria so that teachers with unsatisfactory performance were no 
longer eligible to transfer (see following text box). Hillsborough County adopted a different approach, 
focusing on the principals in schools that are considering which prospective transfer teachers to receive. 
Hillsborough provided those principals access to a “teacher summary sheet” about prospective transfer 
teachers. The sheet provided information on the teacher’s value-added and teaching history (see 
Appendix A-9). 


Description of Houston’s Policy Establishing Eligibility Criteria for Teachers To Transfer 


The Houston School Board placed restrictions on transfers to make sure that ineffective teachers didn’t skip from 
school to school, never addressing their deficiencies. 


In order to be eligible for transfer, teachers must meet the following criteria: 
Hold a valid Texas teacher certificate in the requested subject-area vacancy. 
Meet “Highly Qualified” standards of NCLB for the position. 


Must not be entering third- or fourth-year probationary status. 
Must not be on a growth plan. 


Source: http://www.houstonisd.org/HISDConnectDS/v/index.jsp?vgnextoid=e2c2d5b853 
548210VenVCM10000028147fa6RCRD&venextchannel=9339e02e9 1b23110VenVCM10000028147fa6RCRD. 


Summary 


Although, across the districts, there were policies or programs to address the entire continuum of teacher 
employment and development, from hiring to dismissal, study districts often focused on: 


e Compensation initiatives. All study districts except Hamilton County had in place performance 
pay initiatives that made use of differing teacher effectiveness measures. As noted earlier, these 
programs often served as the impetus to design or redesign teacher effectiveness measures. 


e Feedback through observation. Where study districts had new or revised observation 
frameworks in place, these frameworks appeared to serve as linchpins in district efforts to 
provide useful feedback to teachers and aid them in improving their instructional practices. The 
format of the observations and feedback varied from district to district. 


e Career paths. Several interviewees spoke about their efforts to use effectiveness information to 
identify teachers for leadership positions, as well as to release those determined to be ineffective. 
Districts used different types of information for these purposes. For example, Houston 
described value-added data as a potential source of evidence for dismissal and for granting 
leadership opportunities; Eagle County and Columbus interviewees spoke about the use of 
observation data for both purposes. 
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IV. Taking Targeted Action to Improve 
Equitable Access to Effective Teachers 


Human resources policies that use effectiveness information may help ensure that all students have 
effective teachers, as discussed in chapter III. However, studies have documented that, on average, 
teachers migrate toward working in affluent, high-achieving schools (Hanushek, Kain and Rivkin 2004; 
Goldhaber 2008). Thus, another component of efforts to ensure that all students have effective teachers 
is a set of policies that specifically target high-need schools. 


Information about teachers’ effectiveness enables states and school districts to better address inequities 
in access to effective teachers in several ways. First, states and districts can monitor the distribution of 
teacher effectiveness, rather than qualifications, allowing better identification and targeting of actions to 
high-need schools that lack effective teachers. Second, in those targeted actions, states and districts can 
offer incentives to effective teachers, rather than to all teachers, and can focus attention on high-need 
schools. 


In the five study districts, targeted actions to improve equitable access to effective teachers fell into three 
categories: 


e Analyzing effectiveness data to determine whether and where action is needed 
e Attracting effective teachers to and retaining them in high-need schools 


e Offering principals in high-need schools additional opportunities to hire effective teachers 


Strategies in these areas are discussed in the following sections. A summary of study district efforts in 
these areas is provided at the end of this chapter. 


Analyzing Effectiveness Data to Determine Whether and Where Action 
Is Needed 


There can be great variation across schools within a district in the quality and effectiveness of teachers 
(e.g., Clotfelter and others 2007; Goldhaber, Cramer and Choi 2007; Education Trust 2008; Sass and 
others 2010). To ensure that all students in a district have access to effective teachers, districts must 
analyze and monitor effectiveness information across schools. For example, Houston examined the 
proportion of effective teachers in high-and low-poverty schools, using their value-added measure (see 
Exhibit 11).3 Imazeki and Goe (2009) suggest that districts also take into account information on open 
positions or teacher turnover and teacher experience, using a combination of metrics to determine which 
schools may need targeted assistance. 


3 The state of Tennessee also analyzed teacher effectiveness across schools and found variation by subject across 
schools, indicating a need for programs targeting specific schools, and perhaps specific subject areas in those schools. 
For example, 28 percent of reading or language arts teachers were classified as highly effective in low-poverty schools, 
compared to 17 percent in high-poverty schools. Similar disparities did not exist in mathematics (Tennessee Department 
of Education 2007). Districts can also analyze effectiveness by minority enrollment or achievement status. In their Race 
to the Top applications, states described a number of ways in which they plan to analyze their data. For example, 
Tennessee reported plans to require its districts to examine retention data by effectiveness level, thus tracking the 
attrition of less effective teachers and leaders, for instance. Tennessee will also require its districts to chart the growth of 
teachers and leaders as they become more effective. 
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Exhibit 11 
Houston’s Analysis of Distribution of Effective Teachers, by School Poverty Level 


A study in Houston found, on the basis of value-added data, that there were fewer high-performing teachers at schools with higher percentages of students in 
poverty. In addition, high-performing teachers were less likely to transfer from a low-poverty school to a high-poverty school. 


G@ HISD’s highest poverty schools have the fewest high performing 
teachers, demonstrating the need to provide them with incentives to 
attract effective teachers and better tools to remove low performers. 


Percent of Teachers by EVAAS 
Performance Level and School Free Between 2006-07 and 2009-10... 
and Reduced Price Lunch, 2009-10 
Of transferring high 
performing teachers, 


139 
23% 36% moved toa 
school with a lower 


FRPL percentage. 


compared with... 


Only 28% of 
transferring high 
(1) § Ng 
28% performing teachers 
15% moved to a school 
with higher FRPL 


9% 
0 to 75% FRPL 76 to 100% FRPL percentage. 


Low Performing Middle Performing = High Performing 
Source: HISD Human Resources and EVAAS data . High performing teachers are defined as being in the a top decile of performers in at least 
one subject and not in the bottom quartile in any other subject using two and three year EVAAS averages. Low performing teachers are defined 


1] 


as being in the bottom decile in at least one subject and not in the top quartile in any other subject. 


© The New Teacher Project 2010 


Note: EVAAS is the Education Value-Added Assessment System, which Houston uses to calculate teachers’ contributions to student learning gains. 
Source: Presentation to the Houston Independent School District Board of Education, “Core Initiative Update: Effective Teacher in Every Classroom,” June 3, 


2010. 
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Attracting Effective Teachers to and Retaining Them in High-Need 
Schools 


Although districts may have the authority to reassign teachers as necessary, less coercive means may be 
preferable for bringing effective teachers to high-need schools. Strategies in the study districts and 
elsewhere included both financial incentives and other incentives, such as improvements in working 
conditions. 


Offering Financial Incentives to Attract and Retain Effective Teachers in 
High-Need Schools 


With the exception of Hamilton County, all study districts offered financial incentives to teachers to 
move to or stay in high-need schools.4 However, in only three of the districts (Columbus, Hillsborough, 
and Houston) were the incentives contingent on some measure of effectiveness. For example, National 
Board Certified Teachers (NBCTs) in Hillsborough County received an additional $4,500 for teaching at 
a Renaissance School (i.e., a school with 90 percent or more high-poverty students). They also received a 
$4,000 annual incentive provided to all NBCTs in the district. An additional bonus was given to teachers 
at those Renaissance Schools that reached achievement goals set for the school. That bonus was not 
awarded until the following year, to motivate teachers to remain at the school. Columbus was piloting a 
differentiated compensation program in which teachers with five years of experience and two years of 
demonstrated student achievement gains could seek transfer to a high-needs school and receive a 

$4,000 bonus each year for three years. Houston’s Effective Teacher Pipeline (described in the following 
text box), which was in its first year of implementation during the site visit, identified effective teachers 
by using value-added data and offered incentives to create clusters of effective teachers in targeted 
schools. 


Addressing Other Factors Related to Attracting and Retaining Teachers in 
High-Need Schools 


A key question is whether financial incentives alone are enough to attract or retain teachers, especially in 
the case of schools that may be perceived as difficult or failing. Teachers may be concerned with the 
working conditions in schools, including the support of leadership or peers, opportunities for 
professional development, or other factors. For example, Hillsborough conducted a study to determine 
whether additional compensation had any effect on the retention of high-quality teachers in high-poverty 
schools. In that study, 47 percent of teachers said they would not stay in their schools without the salary 
differential, and 43 percent said they would stay regardless of the extra pay. Among teachers who did 
leave, the main reason they cited was the leadership in the school (McLeod and Watson 2009). Hamilton 
County teachers reported that bonuses provided through an initial phase of the Benwood Initiative, a 
public—private partnership, were not the primary motivation for them to seek or retain employment at a 
struggling school. Instead, they reported being drawn by their personal commitment to traditionally 
disadvantaged students and by the opportunity to work with a visionary principal and a collegial 
professional community that fosters learning (Silva 2008). 


4 One additional possible approach related to offering financial incentives is to allow retired teachers known to be 
effective to return to the classroom as part-time salaried teachers while continuing to draw retirement benefits. This type 
of strategy may need to be pursued at the state level or the district level, depending on local pension-funding 
arrangements. 
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States or districts may seek to address working conditions in tandem with financial incentives. For 
example, Houston’s Effective Teacher Pipeline project sought to address concerns about school working 
conditions by encouraging movement of many effective teachers to a small set of high-priority, 
high-need schools. Placing multiple effective teachers in high-need schools was intended to create a 
culture of supportive peers. In addition, the Effective Teacher Pipeline project provided extra 
professional development and leadership opportunities for teachers moving to those schools.5 


Description of Houston’s Effective Teacher Pipeline Project 


The goal of the Effective Teacher Pipeline project was to identify effective teachers and relocate them as clusters 
onto school campuses, where, in addition to teaching in their core subjects, they would serve as instructional leaders 
for other teachers. Effective teachers who agreed to transfer to the targeted low-performing schools received 
bonuses of $10,000 (funded by an outside foundation) each year for two years. 


A teacher is eligible for the [Effective Teacher Pipeline] program for a particular subject (reading, language arts, 
mathematics, science and/or social studies) as follows: 
Middle schools: 


Teacher was in top 10% of all teachers in that subject within the district, ranked by value-added (Cumulative 
Gain Index [CGI]) for two of the last three years (06-07, 07-08, 08-09) 


Teacher had positive value added (CGI greater than zero) for the year in which they were not ranked in the 
top 10% 

Teacher taught in the subject during 08-09 

Teacher has positive value-added scores (CGI greater than zero) in all other subjects taught, and 

Teacher was placed in group 1, Highly Effective, or group 2, Proficient, during the 09-10 staff review process. 


High schools: 

6. Campus was in top quartile of value added (CGI) for that subject during both 07-08 and 08-09 

7. Teacher was ascribed to that subject for the ASPIRE Award (teaching it for the majority of the day), and 
8. Teacher was placed in group 1, Highly Effective, during the 09-10 staff review process. 


Items to Note: 

— Middle school teachers can be designated in more than one subject. High school teachers cannot. 

— Middle school teacher designation is based on three years of data. High school teacher designation is based on 
two years of data. 


Value-added performance in the most recent school year (09-10) is not used, as this information will not become 
available until fall 2010. 


Source: Houston Effective Teacher Pipeline Program description, June 2010. 


5 Charlotte-Mecklenburg’s Strategic Staffing Initiative goes further, moving principals and highly effective teachers to 
high-need schools as a team (Travers and Christiansen 2010). That is, effective principals are identified and then allowed 
to select effective members of their current school staff to take with them to a high-need school. Another example of 
efforts to address working conditions along with financial incentives is a statewide initiative in Delaware, slated to begin 
in fall 2012. The Delaware Fellows Program would offer $5,000 transfer bonuses to experienced, highly effective 
teachers and principals moving to high-poverty and high-minority schools. The program also would provide special 
summer training and monthly professional development, and in order to be eligible to receive staff, schools must show 
that they are implementing or continuing to implement schoolwide strategies to improve teaching and learning 
environments. It also may be that the geographic characteristics of a particular district or school make it extremely 
difficult to attract or retain effective teachers, even with financial or other incentives. In these instances, states or 
districts may need to consider alternatives that will allow effective teachers to serve high-need schools without actually 
moving to them. Examples of these types of programs could include distance-learning or coaching models, in which 
teachers identified as effective provide direct instruction to students by using technology. For example, Hawaii planned 
to implement a distance-learning program to provide geographically isolated, low-performing schools with access to 
effective teachers. Similarly, states or districts may be able to provide effective teachers to high-need schools as 
instructional coaches, working part-time with teachers and students. 
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Offering Principals in High-Need Schools Additional Assistance With 
Hiring 


In addition to attracting effective teachers to particular schools, another strategy for improving equitable 
access to effective teachers is to offer principals in high-need schools more opportunities to hire 
effective teachers directly. These opportunities could include early hiring options, or exemptions from 
policies that potentially reduce a principal’s ability to hire effective teachers. In many cases, these 
strategies can be undertaken within the context of existing collective bargaining agreements. 


One study district, Hillsborough, mentioned policies intended to offer such opportunities to principals. 
For example, during Hillsborough’s three-day job fair, the first day was limited to the high-poverty 
Renaissance Schools, to give those principals the ability to hire teachers first.° 


In addition, according to district officials in Hillsborough County, principals in its Renaissance Schools 
were exempt from the requirement of selecting transferring teachers on the basis of seniority unless 
there were more teachers transferring than there were other positions available in the district. Instead, 
the principals could choose among those who wished to transfer or could hire teachers new to the 
district, in order to select the best candidates. Finally, when the Renaissance Schools in Hillsborough had 
open positions to fill, they were not subject to district hiring freezes. Instead, the principals could select 
new hires over transfers. 


Summary 


Three of the five study districts developed policies to use effectiveness information in efforts to ensure 
teacher effectiveness in high-need schools. One district, Houston, analyzed effectiveness information to 
determine where inequities within the district might be. The focus of most of these districts was 
monetary incentives to attract effective teachers to high-need schools and retain them. In one case, 
Houston’s Effective Teacher Pipeline project, such incentives were paired with efforts to address 
working conditions in high-need schools. 


6 In its Race to the Top application, the District of Columbia described a similar job-fair strategy called “Smart 
Targeting,” in which principals of high-need schools would meet prescreened applicants before principals of other 
schools would have a chance. The District of Columbia also planned to provide training to principals to help them 
conduct better interviews and find the best candidates for their particular positions. 
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Appendix A Contents 


This appendix contains additional documents collected from districts illustrating their approaches to 
identifying effective teachers and using information about teacher effectiveness in human resource 
policies. The documents are organized according to their appearance in the report. An overview of each 
document is included here. 


Chapter 2: Identifying Effective Teachers 


The appendixes relevant to Chapter 2 include documents related to teacher effectiveness calculations 
(including professional development materials describing these calculations), and observation 
frameworks. 


— Appendix A-1: Eagle County Award Computation—A letter to Eagle County teachers 
explaining how measures of effectiveness based on classroom observation and student 
achievement growth are weighted and combined to calculate salary increases. 


— Appendix A-2: Columbus TAP Award Computation—A description of the eligibility 
requirements and weighting of measures of effectiveness for a Teacher Advancement Program 
(TAP) financial incentive. 


— Appendix A-3: Columbus Performance Advancement System (PAS) Gains Calculation— 
A detailed description of a process used in the district to identify teachers for financial awards 
based on student achievement growth. 


— Appendix A—4: Columbus Value-Added Professional Development Materials—Excerpted 
slides from a presentation explaining value-added computations in the district. 


— Appendix A-5: Hillsborough Current Observation Rubric—The classroom observation 
rubric used in Hillsborough through the 2009-2010 school year. 


— Appendix A-6: Hillsborough New Observation Rubric—The classroom observation rubric 
used in Hillsborough beginning in the 2010—2011 school year. 


— Appendix A-7: Eagle County Professional Practices Rubric—The classroom observation 
rubric in use in Eagle County. 


Chapter 3: Using Information about Teachers’ Effectiveness in Human 
Resource Policies 


The appendixes relevant to Chapter 3 include documents related to guidance for hiring, retention, 
termination, and remediation. 


— Appendix A-8: Houston Decision-Making Framework—Guidance provided to principals 
on how to use effectiveness information to consider staffing actions for teachers in their schools. 


— Appendix A-9: Hillsborough Teacher Summary Sheet—An example of the teacher 
summary sheet (containing effectiveness information) to aid principals in hiring decisions for 
transfer teachers. 
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Fevcsree evenr sivermrren success Certified Exempt/Support/Administrator Performance Appraisal 


2009-2010 School Year 

Name: 

Position: 

Domain Weighting Score Weighted Points 
Job Performance 40% 3 1.20 

Job Knowledge 20% 3 0.60 
Dependability/Reliability 20% 4 0.80 
Organizational Citizenship 10% 3 0.30 
Organizational Representation 10% 4 0.40 


Your Overall Weighted Average = 3.30 


Listed above is your evaluation score for the 2009-10 school year. Please review it carefully and contact Jason Glass, Director 
of Human Resources, if there is an error. Mistakes are rare, but they do happen. Identifying any errors now allows us to make 
a timely correction. 


Per the Spring 2010 Negotiated Agreement, this evaluation score will be used to determine half of your annual performance 
bonus (up to 2% of your base pay) which will be paid this coming August. The other half will be determined by student 
achievement gains in the district (up to an additional 2% of your base pay). You will be provided a separate, and a more 
detailed, communication about how your bonus was determined in August. 


For those retuming for the 2010-11 school year, your base rate of pay will be increased by an amount equal to the bonuses you 
received In September and Novernber of 2009 (unless you have hit the maximum for your position, are a substitute, or in some 
cases are transferring positions). Basically, the cash that was paid in lump sums for the 2009-10 school year will be made 
ongoing for the 2010-11 schcol year 25 part of your base hourly or salaried rate. 


Your current hourly or salaried rate refers to the base hourly or salary amount you made in 2009-10. Extra-duty work, stipends, 
benefit amounts, or other “a la carte" salary additions are not part of your base rate. You can find your base rate by accessing 
the Employee Portal. 


The values of the evaluation Performance Descriptors were determined by the Eagle County Schools Evaluation Committee, 
which is made up of a broad representation of ECS employees. The Evaluation Committee set ranges (or cut points) for these 
categories by booking at the requirements in the evaluation document, which can be accessed via the Employee Portal. 


Performance Descriptor __Rangetow |RangeHigh|  Bonus% | 


High Performing 


Please email Jason Glass with questions or concerns at Jason Glass@eagleschools.net and thank you for a great year! 
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Columbus City Schools TAP 
Performance Pay Award Calculations 
BACKGROUND 


Traditionally, the TAP payout structure allocates a minimum of $2,000 per teacher to establish 
the award fund (Note: many schools base their award fund on $2,500-$3,000 per teacher). The 
award fund is divided into award pools using a ratio of the career path level to the total number 
of teachers eligible for an award. The awards are divided into qualitative measures via the TAP 
Skills, Knowledge, and Responsibilities score and the quantitative student achievement scores 
calculated using value added analysis. ! 


Below are the minimum requirements on the Skills, Knowledge and Responsibilities to be 
eligible to earn the portion of the award pool set aside for that criterion: 


1. Master teachers must earn a SKR score of no less than “4.” 
2. Mentor teachers must earn a SKR score of no less than “3.5.” 
3. Career teachers must earn a SKR score of no less than “2.5.” 


Additionally, there are minimum requirements for both classroom and schoolwide achievement 
scores to be eligible to earn the portions of the award pool set aside for those criteria: 

1. All teacher types must earn a value-added score of no less than “3” on their individual, 
classroom achievement (a score of “3” means in the teacher’s students made one year’s 
expected growth on the state or comparable district assessment). 

2. The schoolwide achievement score must be a value-added score of no less than “3” (a 
score of “3” means the school, on average, made one year’s expected growth on the state 
or comparable district assessment). Schoolwide achievement scores of 3, 4, and 5 will 
earn 50 percent, 75 percent, and 100 percent of the schoolwide bonus, respectively. 


For example, if a career teacher received an SKR score of “3” and a classroom value-added score 
of “2,” they would only be eligible for the SKR portion of the award pool. 


Achievement Award Weights 
For the career teacher with student achievement data, the award pool monies will be allocated as 
follows: 

e 50% Skills, Knowledge, and Responsibilities 

e 30% Classroom achievement gains 

e 20% School achievement gains 


For the career teacher without student achievement data, the award pool monies will be allocated 
as follows: 

e 50% Skills, Knowledge, and Responsibilities 

e 50% School achievement gains 


1 Value-added analysis is a method for measuring the contribution of a teacher or school to gains in student achievement. The 
method uses individual student data linked from year to year, rather than cross-school or cohort averages. It applies statistical 
methods to (a) measure the academic gain or growth of each student over a period of time, and (b) attribute that gain or growth to 
the specific school and teacher(s) responsible for educating each student during that time. 
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Columbus Public Schools Performance Awards for school year 2008—09 

Based on the results from last year, the school district of Columbus will award $251,550 in 
performance pay bonuses to the teachers in schools implementing the TAP System; $400,000 
was allocated. This differential is generated when schools do not achieve a value added score of 
‘5’ and allocated money is unused in a given fiscal year on the bonus awards. 


In the Columbus TAP project, only 26 of the 200 total teachers had individual value added 


scores (13%) for the 2008-09 school year. The middle schools in Columbus have chosen to use 
the 50-50 model mentioned above, even with teachers who teach tested grades or subjects. 
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APPENDIX A-3: 
COLUMBUS PERFORMANCE ADVANCEMENT 
SYSTEM (PAS) GAINS CALCULATION 
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Data Analysis Procedures for PAS award in Columbus City Schools 


The PAS award is given to those teachers whose average student achievement gain is equal to or greater 
than 3 NCE above the District gain from the same pre- and post-test assessments. Because dissimilar 
measures typically are used on the pretests and posttests, scores are converted to a standard scale 
called a z score. These z scores are then further converted to the Normal Curve Equivalent (NCE) for easy 
comparison. 


z Score 

The z score is the number of standard deviation units an individual student’s raw score is above or below 
the district mean. It has a one-to-one relationship with the standard deviation unit, one z-score unit = 
one standard deviation unit. On the z score scale the mean is set at zero. The z score is calculated by 
taking the raw score for a student, subtracting the district mean (average) of all student scores and 
dividing by the district standard deviation on the assessment. 


z score = (student raw score — district mean) /district standard deviation 


Normal Curve Equivalent 
The Normal Curve Equivalent is derived from the z score. On the NCE scale, the mean is set at 50% and 


each unit of standard deviation is represented by a 21.06% increase or decrease from the mean. The 
NCE has a range of 1 to 99%. The Normal Curve Equivalent can be thought of as the raw score 
percentage fitted to the normal distribution (bell curve). The NCE is calculated by multiplying the z score 
by 21.06 and adding 50. 


NCE = (z score x 21.06) + 50 


If you want to know the numbers used to calculate your class gain, contact the PAS Coordinator. She can 
print a spreadsheet detailing each of your students’ pre- and post-test scores, the z-scores, and the NCE 
equivalents used. She can also give you the district mean and standard deviation for the assessments 
used in your gains analysis. You can calculate your own gains by finding your class’ average pretest NCE 
score and subtracting it from the class’ average posttest NCE score. Remember, your students’ NCE 
scores already reflect the comparison to the district’s mean. If the difference is a positive 3.0 or greater, 
you are eligible for the award. 


A confusing phenomenon, negative gain, occurs if your students make gains, but not as much as the 
district. If subtracting the pretest from the posttest NCE average results in a negative number; that is 
known as a negative gain. 


Value-added 

For some teachers, the PAS award will be given if their mean student achievement gain exceeds one 
year of growth as determined by value-added calculation. The predicted mean approach will be used. 
For each student sample, a mean prediction of achievement on the next iteration of the Ohio 
Achievement Test will be calculated. Using test data for students with similar prior performance on 
common tests and the tests’ relationships to each other allows for the creation of statistically reliable 
predicted scores for each student in each subject. At the end of the year, a student sample mean of 
actual achievement will be calculated. The difference between the actual scores and the predicted 
scores is called the effect, or value-added score. 


It is not possible for a teacher to calculate their own value-added score as it is necessary to have 
multiple years of testing history for both the individual students and the comparison pool. There are 
about 40 Ohio school districts in the comparison pool. Districts are grouped into pools based on 
common testing histories at each grade-level cohort. 
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APPENDIX A-—4: 
COLUMBUS VALUE-ADDED PROFESSIONAL 
DEVELOPMENT MATERIALS 
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What is School Effect 
(or Value-Added)? 


School Effect ~ Growth — Expected Growth 


mE 
4 _ = Value-Added 
es > kh 


Calculating School Effect 


Test Scales Determine the Statistical Approach 


¢ Mean Gain Approach 
- Used when all tests across grade levels 
have consistent scales. 


School Effect = Growth — Expected Growth 


e Predicted Mean Approach 


E - Used when one or more tests are on 
< a different scale. 
3 
s School Effect = Observed Mean — Predicted Mean 
ANALYSIS 
Miter: 
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Test Scales 


Consistent Scales (Mean Gain Approach) 


* Vertical Scales reference scores increase in equal intervals. 
50th Percentile 3rd 4th 5th 6th 7th 8th 
Score 350 400 450 500 550 600 


© Horizontal Scales share a common scale and score range. 


Different Scales (Predicted Mean Approach) 
® Different Scales reference scores vary inconsistently. 


50th Percentie 3rd 4th Sth 6th 7th 8th 
Score 450 220 550 220 650 700 


a] 
3 
if 
qi, 


ANALYSIS 
-— Bareeorkids 
seen 


RE ESE SE ETE 


Mean Gain Approach 


Used when all tests across grade 
levels have consistent scales. 


School Effect = Mean Gain — Expected Growth 
R-* 
NS 


-) 
3 
8 ; 
$ 


ANALYSIS 
__ Bameseforkids 
Sermons 
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Mean Gain Example 


Math scaled scores for the same students. 


Year1« Grade 3 Year2* Grade4 
Student 1 350 Student 1 400 
Student 2 370 Student 2 385 
Student 3 360 Student 3 B90. 
Student 4 319 Student 4 405 
Student 5 365 Student 5 390 
Mean Baseline = 364 Mean Observed = 395 


Growth = Mean Observed — Mean Baseline 
Growth = 395 — 364 


nantes A crude measure of the growth is 31 scaled score points. 


a 


Mean Gain Example 


School effect is a comparison between students’ 
growth and their expected growth. 


School Effect ~ Mean Gain — Expected Growth 


6 = 31 - 25 (Growth Standard) 


Students, on average, grew about 6 scaled 
score points more than expected. 


> 


NALYSIS 
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Mean Gain Approach (Converted to NCEs) 


Sample School Estimated School Mean NCE Gain 
Value-Added | 4 
Report Math 


High Progress 
Positive School 
Effects 


High Mean NCE or 
Mean Scaled Score 


Estimated School Mean NCE Scores 


State Base Year(199¢)| 5.0 | so | 


R — Estimated mean NCE gain Below the growth standard 
Y — Estimated mean NCE gain not detectably different from the growth standard. 


lis ‘Batielie forKicls. G — Estimated mean NCE gain above the growth standard @SAS Institute Inc. 
a | Stet sae is Used with permission. 


Review: 
Predicted Mean Approach 


Used when one or more tests 
are on a different scale. 


School Effect ~ Observed Mean — Predicted Mean 
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Predicted Mean Example 


Math scaled scores for the same students. 


Predicted 4th Grade Observed 4th Grade 
Student 1 390 Student 1 400 
Student 2 384 Student 2 385 
Student 3 396 Student 3 395 
Student 4 395 Student 4 405 
Student 5 385 Student 5 390 
Predicted Mean Mean Observed = 395 


(Baseline) = 390 


: School Effect ~» Mean Observed — Predicted Mean 
(Baseline) 

3 School Effect = 395 — 390 

$ School Effect = 5 


ANALYSIS 


Raabe ftdds 
lee. 


Predicted Mean Approach 


High Achievement, High Progress 


Battelle; , Home Search ContactUs Help Admin User Settings Logout 


93 Print this Report 
2005 School Value-Added Report for 
Math Grade 4 


Observed Baseline 


aw 
ae 


High Achievement High Progress 
ANALYSIS High Mean Scores Positive School 
Effects ? 
Bate ieks rain 


Cire sae on 
BRE 'S Wile + en 
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Predicted Mean Approach 


Low Achievement, High Progress 


2 Print this Report 
2005 School Value-Added Report for 
Math Grade 4 


oneal 


Low Achiovement High Progress 
Low Mean Scores Positive School 
Effects 


@SAS Institute Inc. 
Used with permission. 
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APPENDIX A—5: 
HILLSBOROUGH CURRENT 
OBSERVATION RUBRIC 


Appendix A—5 65 


oO) CLASSROOM CERTIFICATED INSTRUCTIONAL EFFECTIVENESS EVALUATION 


Hillsborough County Spring or Fall (circle one) 


PUBLIC SCHOOLS 


Excellence in Education 


O= 
|. INSTRUCTIONAL EFFECTIVENESS (Point values: O = 10; S = 6; NI = 4.5; U=0) 


o 


. PLANNING AND PREPARATION (Point values: O = 4; S = 2; NI = 1.5; U=0) 


. PROFESSIONAL BEHAVIORS (Point values: O = 4; S = 2; NI= 1.5; U=0) 


- TECHNIQUES OF INSTRUCTION (Point values: O = 6; S = 3; NI= 2.5; U=0) 


PREPRINTED EMPLOYEE AND ASSIGNMENT 
DATA TO BE PLACED HERE 


Please check (\) the appropriate rating in each area 


ie) s NI U ie} $s NI U 
BARR EE REE 


Outstanding S = Satisfactory NI = Needs Improvement U = Unsatisfactory 


Promotes academic learning designed to improve student performance 


ENTER SECTION TOTAL PTS (MAX 10) 


Plans effective lessons consistent with State and District curriculum frameworks. 
Identifies lesson objectives appropriate for the level of achievement of individual students based on 
curriculum goals 


Selects appropriate resource materials and activities related to effective lesson objectives 
Selects effective lesson materials and activities that include cultural contributions of various groups 


Sequences the use of materials and activities for effective lesson preparation 


Identifies effective procedures to assess student attainment of lesson objectives 
ENTER SECTION TOTAL PTS (MAX16)| | 
fe) $s NI U fe) $s NI U 


Adheres to State, District and School policies and procedures 


Contributes to and participates in the School Improvement Plan 

Is punctual in reporting to school and in carrying out school assignments 

Observes confidentiality relating to students, teachers and school 

Performs with a minimum of supervision 

Communicates effectively with students and other stakeholders to increase student achievement 
Works cooperatively and supportively with the school staff. 

Demonstrates logical thinking and makes practical decisions 

Makes suggestions and offers criticism with discretion 

Responds reasonably to and acts appropriately upon constructive criticism 


Dresses appropriately and is well groomed pt 


Engages in self-assessment and participates in professional development activities to improve instructional 
effectiveness 


ENTER SECTION TOTAL PTS (MAX 28) 


Demonstrates knowledge of subject matter 


Uses instructional time efficiently while employing the principles of continual quality improvement in an 
instructional setting with students 


Orients students to class work and maintains academic focus 


Uses vocabulary and presents content appropriate to the subject area and to the students’ abilities while 
using appropriate strategies for teaching students from diverse cultural backgrounds, with different learning 
styles, and with special needs 

Presents subject matter effectively using technology where appropriate and available, while using 
appropriate skills and strategies that promote the creative/critical thinking capabilities of students. 


DISTRIBUTION: FALL: Original to teacher; copy to site file. SPRING: Original to Personnel Services, copies to teacher and site file. 
$B34800 
Rev 7/2007 
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£) CLASSROOM CERTIFICATED INSTRUCTIONAL EFFECTIVENESS EVALUATION 


Hillsborough County Spring or Fall (circle one) 
PUBLIC SCHOOLS 


Excellence in Education 


Please check (\) the appropriate rating in each area 


O = Outstanding 
TECHNIQUES OF INSTRUCTION 


S = Satisfactory = Unsatisfactory 


(Point values: O = 6; S = 3; NI = 2.5; U=0) 


NI = Needs Improvement 


VV Continued 


Gives directions in a clear, concise manner 
g. Uses appropriate questioning techniques 
h. Uses students’ responses/amplifies/gives feedback. 


i. Uses praise appropriately 
j. Checks for comprehension during instruction 
k. Holds students accountable for and gives appropriate feedback on seatwork/homework 


Circulates and assists students during seat work 


Demonstrates enthusiasm when presenting content 
Uses effective traditional and altemative assessment procedures that provide for individual, ethnic and 
cultural differences of students 


7 3 


o. Uses supportive data to arrive at a grade or indication of student progress and uses technology to manage systems of 
instruction, record keeping, and reporting systems where appropriate and available 


CLASSROOM MANAGEMENT 


(Point values: O = 6; S = 3; NI=2.5; U=0) 


Establishes and maintains standards for acceptable student behavior 


b. Maintains instructional momentum 


Stops misconduct using effective, appropriate techniques 


c 
d. Exhibits consistency when dealing with student behavior 
e. Enhances and maintains students’ self-esteem 

f 


Monitors students to remain on task 


g. Uses and maintains equipment and classroom properly 


DATE OF SELF-EVALUATION: SIGNATURE OF TEACHER: 


OVERALL EVALUATION RATINGS: O = Outstanding S = Satisfactory NI = Needs Improvement Unsatisfactory 


EVALUATION RATING 
Instructional personnel are expected to meet or exceed satisfactory standards in every | OVERALL “O” > 137.0 GRAND TOTAL [= =] 
aspect of their performance and to strive to achieve outstanding ratings in all appropriate | OVERALL “S” = 97.5- 136.5 
competencies. The score of achieving all “Satisfactory” ratings is 108 andis the minimum | OVERALL “NI” = 86.5-97.0 (CIRCLE ONE RATING) 


expected standard for all teachers. OVERALL “U” < 86.0 ie) iS) NEU 


Vi. EVALUATOR’S COMMENTS AND/OR SUGGESTIONS: (additional pages allowed) 


Vil. TEACHER’S COMMENTS AND/OR SUGGESTIONS: (additional pages allowed) 


Signature of Evaluator: Date: 


Signature of Teacher: Date: 


DISTRIBUTION: FALL: Original to teacher; copy to site file. SPRING: Original to Personnel Services, copies to teacher and site file. 
$B34800 
Rev 7/2007 
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APPENDIX A-6: 
HILLSBOROUGH NEW OBSERVATION RUBRIC 
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Performance rating 


Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 
‘Domain weight: 20%, 


Domain 1: Planning and Preparation 


1a. Demonstrating The teacher's plans and practice The teacher's plans and practice The teacher's plans and practice The teacher's plans and practice 
Knowledge of Content display little knowedge of the reflect some awareness of the teflect solid knowledge of the content, |refiect extensive knowledge of the 
and Pedag ogy content, prerequisite relationships im int con: in isciplit prerequisite relationships between content, the structure of the discipline 
between different aspects of the prerequisite relationships between important concepts, and the and instructional practices. The 
content, or the instructional practices jthem, and the instructional practices instructional practices specific to that |teacher actively builds on knowledge 
(Component weight: 4%) _|specific to that discipline. specific to that discipline. discipline. of prerequisites and misconceptions 
when describing instruction or seeking 
causes for student misunderstanding, 


The teacher stays abreast of 
emerging research areas, new and 
innovative methods and incorporates 
them into lesson plans and 
instructional strategies. 


Knowledge of content and the structure of the discipline 
Knowledge of prerequisite relationships 
ledge of content-related pedagog 
1b. Demonstrating The teacher demonstrates little or no |The teacher indicates the importance |The teacher actively seeks The teacher actively seeks 
Knowledge of Students knowledge of students’ backgrounds, jof understanding students’ knowledge of students’ backgrounds, |knowledge of students’ backgrounds, 
cultures, skills, learning levels / styles, |backgrounds, cultures, skills, learning |cultures, skills, learning levels / styles, |cultures, skills, learning levels / styles, 
Om language proficiencies, interests, and |levels / styles, language proficiencies, |language proficiencies, interests, and |language proficiencies, interests, and 
(Component weight: 4%) | special needs, and does not seek interests, and special needs, and special needs, and attains this special needs from a variety of 
attains this knowledge for the class as |knowledge for groups of students. sources, and attains this knowledge 


Elements include: 
Knowledge of child and adolescent development 
Knowledge of the learning process 
Knowledge of students’ skills, knowledge, and language proficiency 
Knowledge of students’ interests and cultural heritage 
edge of students’ special needs 
1c. Setting Instructional Instructional outcomes are unsuitable |Instructional outcomes are of Instructional outcomes are stated as__| instructional outcomes are stated as 
Outcomes for students, represent trivial or low- |moderate rigor and are suitable for goals reflecting high-level learning goals that can be assessed, reflecting 
level learning, or are stated only as |some students, but consist of a and curriculum standards. They are [rigorous learning and curriculum 
F activities. They do not permit viable {combination of activities and goals, suitable for most students in the class, |standards. They represent different 
(Component weight: 2%) _|methods of assessment. some of which permit viable methods |represent different types of learning, types of content, offer opportunities 
of assessment. They reflect more land can be assessed. The outcomes [for both coordination and integration, 
The teacher develops general than one type of learning, but the reflect opportunities for coordination. |and take account of the needs of 
student achievement goals for her or [teacher makes no attempt at individual students. 
coordination or integration. The teacher develops measurable 
student achievement goals for her or |The teacher develops ambitious and 
The teacher develops measurable _|his class that are aligned to content [measurable student achievement 
student achievement goals for her or goals for her or his class that are 
aligned to the content standards. 


Elements include: 

Value, sequence, and alignment 

Clarity 

Balance 

Suitability for diverse learners 
1d. Demonstrating The teacher demonstrates little or no |The teacher demonstrates some The teacher is fully aware of the The teacher seeks out resources and 
Knowledge of Resources familiarity with resources and familiarity with resources and resources and technology available _| technology (as available) in and 
and Technolo technology to enhance own technology available through the through the school or district to beyond the school or district in 

gy knowledge, to use in teaching, orto | school or district to enhance own lenhance own knowledge, touse in _| professional organizations, on the 
- provide for students who need them. |knowledge, to use in teaching, orto teaching, or to provide for students _| Internet, and in the community to 
(Component weight: 2%) |The teacher does not seek such provide for students who need them. |who need them enhance own knowledge, to use in 
The teacher does not seek to extend teaching, and to provide for students 


Elements include: 
Resources and technology for classroom use 
Resources and technology to extend content knowledge and pedagogy 
Resources and technology for students 
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te. Designing Coherent 
Instruction 


(Component weight: 4%) 


The series of learning experiences is 
poorly aligned with the instructional 
outcomes and does not represent a 
coherent structure. The experiences 
are suitable for only some students. 


The teacher does not plan units by 
identifying the content standards that 
his or her students will master in each 
unit OR does not articulate well- 
designed essential questions for each 
unit. 


Instructional materials and resources 


Instructional groups 


Lesson and unit structure 


1f. Designing Student 
Assessments 


(Component weight: 4%) 


Elements include: 


The teacher's plan for assessing 
student learning contains no clear 
criteria or standards, is poorly 
aligned with the instructional 


Performance rating 


Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 


The teacher coordinates knowledge of |The teacher coordinates knowledge of 


The series of learning experiences 
demonstrates partial alignment with 
instructional outcomes, and some of 
the experiences are likely to engage 
students in significant learning. The 
lesson or unit has a recognizable 
structure and reflects partial 
knowledge of students and resources. 


Based on the annual student 
achievement goal, the teacher plans 
units by using 2 of the 4 practices: 1) 


content, of students, and of content, 
with students, and of resources to 
design a series of learning 
experiences aligned to instructional 
outcomes and suitable for groups of 
students, The lesson or unit has a 
clear structure and is likely to engage 
students in significant learning. 


Based on the annual student 
achievement goal, the teacher plans 


identifying the content standards that| units by using 3 of the 4 practices: 1) 
his or her students will master in each |identifying the content standards that|achievement goal, the teacher plans 
his or her students will master in each units by using all 4 practices: 1) 


unit; 2) articulating 

well-designed essential questions for 
each unit, 3) employing backward 
design in structuring units; and 4) 
allocating an instructionally 
appropriate amount of time for each 
unit. 


The teacher's plan for student 
assessment is partially aligned with 
the instructional outcomes, without 


unit; 2) articulating 

well-designed essential questions for 
each unit, 3) employing backward 
design in structuring units; and 4) 
allocating an instructionally 
appropriate amount of time for each 
unit. 


The teacher's plan for student 
assessment is aligned with the 
instructional outcomes, uses clear 


clear criteria, and / or inappropriate for|criteria, and is appropriate to the 


outcomes, or is inappropriate for many|at least some students. The teacher 


students. The results of assessment 


intends to use assessment results to 


needs of students. The teacher 
intends to use assessment results to 


have minimal impact on the design of |plan for future instruction for the class |plan for future instruction for groups 


future instruction 


Congruence with instructional outcomes 


Criteria and standards 


Design of formative assessments 


Use for planning 


Appendix A-6 


as a whole. 
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of students. 


content, of students, and of resources 
to design a series of learning 
experiences aligned to instructional 
outcomes, differentiated where 
appropriate to make them suitable for 
all students, and likely to engage them 
in significant learning. The lesson or 
unit structure is clear and allows for 
different pathways according to 
student needs 


Based on the annual student 


identifying the content standards that 
his or her students will master in each 
unit; 2) articulating 

well-designed essential questions for 
each unit, 3) employing backward 
design in structuring units; and 4) 
allocating an instructionally 
appropriate amount of time for each 
unit 


The teacher's plan for student 
assessment is fully aligned with the 
instructional outcomes, with clear 
criteria and standards that show 
evidence of student contributions to 
their development The teacher may 
have adapted assessment for 
individuals, and the teacher intends to 
use assessment results to plan future 
instruction for individual students 


Performance rating 
Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 
Domain 2: The Classroom Environment Domain % of evaluat - 20% 


2a. Creating an 
Environment of Respect 
and Rapport 


(Component weight: 5%) 


Elements include: 


Classroom interactions, both between |Classroom interactions, both between [Classroom interactions between the 


the teacher and students and among 
students, are negative, inappropriate, 
or insensitive to students’ cultural 


the teacher and students and among 
students, are generally appropriate 
land free from conflict, but may be 


backgrounds and are characterized by|characterized by occasional displays 


sarcasm, put-downs, or conflict. 


Teacher interaction with students 
Student interactions with other students 


2b. Establishing a Culture 
for Learning 


(Component weight: 5%) 


Elements include: 


The classroom environment conveys 
a negative culture for learning, 
characterized by low teacher 
commitment to the subject, low 
expectations for student achievement, 
little or no student pride in work and 
Ino evidence that students believe that 
they can succeed if they work hard. 


Importance of the content 
Expectations for learning and achievement 


Student pride in work 
Procedures 


(Component weight: 
2.5%) 


Elements include: 


because of inefficient classroom 
routines and procedures for 
transitions, handling of supplies, and 
performance of non-instructional 


Management of instructional groups 
Management of transitions 
Management of materials and supplies 
Performance of noninstructional duties 


Sup 
2d. Managing Student 
Behavior 


(Component weight: 5%) 


Expectations 


vision of volunteers and pa 


aprofessionals 

There is no evidence that standards 
of conduct have been established and 
little or no teacher monitoring of 
student behavior. Response to 
student misbehavior is repressive or 
disrespectful of student dignity. 


The teacher does not reinforce 
positive behavior. The teacher does 
not address off-task, inappropriate, or 
challenging behavior efficiently. 


Inappropriate and off-task student 
behavior has significant negative 
impact on the learning of students in 
the class. 


Monitoring of student behavior 
Response to student misbehavior 
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lof insensitivity or lack of 
responsiveness to cultural or 
developmental differences among 


The teacher's attempt to create a 
culture for learning is partially 
successful, with little teacher 
commitment to the subject, little 
evidence that students believe they 
can succeed if they work hard, 
modest expectations for student 


teacher and students and among 
students are polite and respectful, 
reflecting general warmth and caring, 


Classroom interactions among the 
teacher and individual students are 
respectful, reflecting genuine warmth 
land caring and sensitivity to students’ 


and are appropriate to the cultural and|cultures and levels of development. 


developmental differences among 
groups of students. 


The classroom culture is 


Students themselves ensure high 


High levels of student energy and 


characterized by high expectations for |teacher passion for the subject create 
most students, the belief that students |a culture of learning in which 


ican succeed if they work hard, and 
genuine commitment to the subject by 
both teacher and students, with 
students demonstrating pride in their 


achievement, and little student pride in]work, 


work. Both teacher and students 
lappear to be only “going through the 


‘Some instructional time is lost 
because classroom routines and 
procedures for transitions, handling of 
supplies, and performance of non- 
instructional duties are only partially 


It appears that the teacher has made 
an effort to establish standards of 
conduct for students and tries to 
monitor student behavior and respond 
ito student misbehavior, but these 
efforts are not aways successful. 


The teacher reinforces positive 
behavior. The teacher addresses 
some off-task, inappropriate, or 
challenging behavior efficiently. 


Inappropriate and off-task student 
behavior has some negative impact 
lon the learning of students in the 
class. 
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Little instructional time is lost because 
lof classroom routines and procedures 
for transitions, handling of supplies, 
and performance of non-instructional 
duties, which occur smoothly 


Standards of conduct appear to be 
clear to students, and the teacher 
monitors student behavior against 
those standards. The teacher's 
response to student misbehavior is 
appropriate and respectful to 
students. 


The teacher strategically reinforces 
positive behavior. The teacher 
addresses most off-task, 
inappropriate, or challenging behavior 
efficiently. 


Inappropriate and off-task student 
behavior has little negative impact on 
the learning of students in the class. 


leveryone shares a belief in the 
importance of the subject and the 
belief that students can succeed if 
they work hard. All students hold 
themselves to high standards of 
performance—for example, by 


Students contribute to the seamless 
operation of classroom routines and 
procedures for transitions, handling of 
supplies, and performance of non- 


Standards of conduct are clear, with 
evidence of student participation in 
setting them. The teacher's monitoring 
lof student behavior is subtle and 
preventive, and the teacher's 
response to student misbehavior is 
sensitive to individual student needs. 
Students take an active role in 
monitoring the standards of behavior. 


The teacher strategically reinforces 
positive behavior AND there is 
significant evidence that students 
reinforce positive classroom culture. 
The teacher addresses almost all off- 
task, inappropriate, or challenging 
behavior efficiently. 


Inappropriate and off-task student 
behavior has no negative impact on 
the learning of students in the class. 


Performance rating 


Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 
2e. Organizing Physical |The physical environment is unsafe, |The classroom is safe, and essential |The classroom is safe, and learning is |The classroom is safe, and the 
Space jor some students don't have access {learning is accessible to most accessible to all students; the teacher [physical environment ensures the 


ito learning. Alignment between the | students; the teacher's use of physical/ensures that the physical arrangement|learning of all students, including 
physical arrangement and the lesson |resources, including computer supports the learning activities. The {those with special needs. Students 


(Component weight: activities is poor. technology, is moderately effective. teacher makes effective use of contribute to the use or adaptation of 

2.5%) The teacher may attempt to modify the] physical resources, including ithe physical environment to advance 
physical arrangement to suit learning |computer technology. learning. The teacher uses technology 

skillfully, as appropriate to the lesson. 


Elements include: 
Safety and accessibility 
Arrangement of furniture and use of p 
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Performance rating 
Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 
Domain 3: Instruction Poehler - 40% 


3a. Communicating with 
Students 


(Component weight: 9%) 


Expectations for learning 


The teacher has an inadequate 
presence inthe classroom. The 
teacher ineffectively develops 
students’ understanding of the 
objective by not communicating it, OR 
teacher does not have a clear 
objective, OR teacher's lesson does 
not connect to the objective. 


Directions and procedures 


Explanations of content 


3b. Using Questioning 
and Discussion 
Techniques 


(Component weight: 9%) 


Elements include: 


Quality of questions 
Discussion techniques 
Student participati 
3c. Engaging Students in 
Learning 


(Component weight: 9%) 


Elements include: 


of content, but misses nearly all key 
moments and does not get an 
accurate pulse of the class's 
understanding from most checks; the 
teacher does not check for 
understanding. 


The teacher's questions are low-level 
or inappropriate, eliciting limited 
student participation and recitation 
rather than discussion. The teacher 
never responds to students’ correct 
lanswers by probing for higher-level 
understanding in an effective manner. 


The teacher has a solid presence in 
ithe classroom. The teacher 
effectively develops students’ 
understanding of the objective by 1) 
communicating what students will 
know or be able to do by the end of 
the lesson and 2) connecting the 
objective to prior knowledge. 


lof content, but misses several key 
moments and gets an accurate pulse 
lof the class’s understanding from 
most checks such that the teacher 
has enough information to adjust 
subsequent instruction if necessary. 


Some of the teacher's questions elicit 
a thoughtful response, but most are 
low-level, posed in rapid succession. 
The teacher rarely responds to 
students’ correct answers by probing 
for higher-level understanding in an 
effective manner. The teacher's 
attempts to engage all students in the 
discussion are only partially 
successful. 


The teacher has a solid presence in 
the classroom. The teacher 
effectively develops students’ 
understanding of the objective by 1) 
communicating what students will 
know or be able to do by the end of 
ithe lesson; 2) connecting the 
objective to prior knowledge; and 3) 
explaining the importance of the 
objective. 


of content, but misses one or two 
key moments and gets an accurate 
pulse of the class's understanding 
from almost every check such that 
the teacher has enough information to 
adjust subsequent instruction if 
necessary. 


Most of the teacher's questions elicit a 
thoughtful response, and the teacher 
allows sufficient time for students to 
answer. The teacher sometimes 
responds to students’ correct answers 
by probing for higher-level 
understanding in an effective manner. 
All students participate in the 
discussion, with the teacher stepping 
aside when appropriate. 


(Activities and assignments, materials, [Activities and assignments, materials, [Activities and assignments, materials, 
land groupings of students are partially}and groupings of students are fully 


land groupings of students are 
inappropriate for the instructional 
outcomes or students’ cultures or 
levels of understanding, resulting in 
little intellectual engagement. The 
lesson has no structure or is poorly 


Activities and assignments 


Grouping of students 


appropriate for the instructional 
loutcomes or students’ cultures or 
levels of understanding, resulting in 
moderate intellectual engagement. 
The lesson has a recognizable 
structure, but that structure is not fully 


Use of instructional materials, resources and technology (as available) 


Structure and pacing 
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appropriate for the instructional 
loutcomes and students’ cultures and 
levels of understanding. All students 
are engaged in work of a high level of 
tigor. The lesson’s structure is 
coherent and is appropriately paced. 


The teacher has a dynamic presence 
in the classroom. The teacher 
effectively develops students’ 
understanding of the objective by 1) 
communicating what students will 
know or be able to do by the end of 
the lesson; 2) connecting the 
objective to prior knowledge; 3) 
explaining the importance of the 
objective; and 4) referring to the 


lof content at all key moments and 
gets an accurate pulse of the class’s 
understanding from every check such 
that the teacher has enough 
information to adjust subsequent 
instruction if necessary. 


(Questions reflect high expectations 
and are culturally and developmentally 
appropriate. The teacher frequently 
responds to students’ correct answers 
by probing for higher-level 
understanding in an effective manner. 
Students formulate many of the high- 
level questions and ensure that all 
voices are heard. 


Students throughout the lesson are 
highly intellectually engaged in 
significant learning and make material 
and relevant contributions to the 
activities, student groupings, and 
materials. The lesson is adapted as 
necessary to the needs of individuals, 
land the structure and pacing allow for 
student reflection and closure. 


3d. Using Assessment in 
Instruction 


(Component weight: 9%) 


Elements include: 
Assessment criteria 


Assessment is not used in 
instruction, either through monitoring 
lof progress by the teacher or 
Istudents, or through feedback to 


Performance rating 


Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 


Assessment is occasionally used in 
instruction, through some monitoring 
lof progress of learning by teacher 
land/or students. Feedback to 


students; students are unaware of the |students is uneven, and students are 
assessment criteria used to evaluate [aware of only some of the assessment|students. Students are fully aware of 


their work 


Monitoring of student learning 


Feedback to students 


Student self-assessment and monitoring : 
The teacher adheres to the instruction |The teacher attempts to modify the 


3e. Demonstrating 
Flexibility and 
Responsiveness 


(Component weight: 4%) 


Elements include: 
Lesson adjustment 


Response to students 
Persistence 
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plan, even when a change would 
improve the lesson or address 
students’ needs. The teacher 
brushes aside student questions; 
when students experience difficulty, 
the teacher blames the students or 
their home environment. 


The teacher does not re-teach. 


criteria used to evaluate their work. 


lesson when needed and to respond 
ito student questions with moderate 
isuccess. The teacher accepts 
responsibility for student success, but 
has only a limited repertoire of 
strategies to draw upon. 
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Assessment is regularly used in 
instruction, through self-assessment 
by students, monitoring of progress of 
learning by the teacher and/or 
students, and high-quality feedback to 


ithe assessment criteria used to 
evaluate their work. 


The assessments provide students 
with multiple ways to demonstrate 
mastery. 


The teacher promotes the successful 
learning of all students, making 
adjustments as needed to instruction 
plans and accommodating student 
questions, needs, and interests. 


In response to student progress data, 
ithe teacher 1) re-teaches, as 
appropriate, and 2) modifies long- 


Assessment is routinely used ina 
sophisticated manner in instruction 
through student involvement in 
establishing the assessment criteria, 
self-assessment by students, 
monitoring of progress by both 
students and teachers, and high- 
quality feedback to students from a 
variety of sources. 


The assessments provide students 
with multiple ways to demonstrate 
mastery and multiple opportunities 


The teacher seizes an opportunity to 
enhance learning, building ona 
spontaneous event or student 
interests. The teacher ensures the 
success of all students, using an 
extensive repertoire of instructional 
strategies. 


In response to student progress data, 
ithe teacher 1) re-teaches, as 
appropriate, 2) modifies long-term 
plans, as appropriate, and 3) 
modifies practice, as appropriate. 


(Component weight: 3%) 


Accuracy 

Use in future teaching 
4b. Maintaining Accurate 
Records 


(Component weight: 3%) 


The teacher does not accurately 


Performance rating 
Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 
Domain 4: Professional responsibilities (Domed % of avaliation - 20% 


‘The teacher provides a partially 


assess the effectiveness of the lesson|accurate and objective description of 


land has no ideas about how the 


the lesson but does not cite specific 
evidence, The teacher makes only 
general suggestions as to how the 


The teacher provides an accurate 
and objective description of the 
lesson, citing specific evidence. The 
teacher makes some specific 
suggestions as to how the lesson 
might be improved. 


The teacher's reflection on the lesson 
is thoughtful and accurate, citing 
specific evidence. The teacher draws 
on an extensive repertoire to suggest 
alternative strategies and predicts the 
likely success of each 


The teacher's systems for maintaining |The teacher's system for maintaining |The teacher's systems for maintaining |The teacher's systems for maintaining 


both instructional and non- 
instructional records are either 
nonexistent or in disarray, resulting 
in errors and confusion. 


Student completion of assignments 
Student progress in learning 


Noninstructional records 
4c. Communicating with 
Families 


(Component weight: 4%) 


Elements include: 


The teacher's communication with 
families about the instructional 
program or about individual students 
is sporadic or culturally 
inappropriate. The teacher makes 
no attempt to engage families in the 
instructional program. 


Information about the instructional program 
Information about individual students 


(Component weight: 3%) 


Elements include: 


collaborates with colleagues; and 
relationships with colleagues are 
negative or self-serving. 


Relationships with colleagues 
Involvement in a culture of professional inquiry 


Service to the school 


jpation in school and district 


Developing Professionally 


professional development activities 
land makes no effort to share 
knowledge with colleagues. The 
teacher is resistant to feedback from 
supervisors or colleagues. 


both instructional and non- 


both instructional and non- 


instructional records are rudimentary |instructional records are accurate, 


and only partially effective, 


‘The teacher adheres to school 
procedures for communicating with 


efficient, and effective. 


‘The teacher communicates 
frequently with families and 


families and makes modest attempts |successfully engages them in the 


ito engage families in the instructional 
program. However, communications 
are not always appropriate to the 
cultures of those families. 


to collaborate with colleagues, and 
relationships with colleagues are 


professional development activities 
that are convenient or are required 
and makes limited contributions to the 
profession. The teacher accepts, 
with some reluctance, feedback from 
supervisors and colleagues. 


Enhancement of content knowledge and pedagogical skill 
Receptivity to feedback from colleagues 
Service to the i 
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instructional program. Information to 
families about individual students is 
conveyed in a culturally appropriate 
manner. 


opportunities to collaborate with 
others, and maintains positive and 
productive relationships with 


The teacher seeks out opportunities 
for professional development based 


both instructional and non- 
instructional records are accurate, 
efficient, and effective. Students 
contribute to the maintenance of these 
systems. 


The teacher's communication with 
families is frequent and sensitive to 
cultural traditions; students participate 
in the communication. The teacher 
successfully engages families in the 
instructional program as appropriate. 


contribution to the professional 
community and to school and district 
events and projects, collaborates with 
/ coaches others through difficult 
situations, and assumes a leadership 
role among the faculty. 


The teacher actively pursues 
professional development 


on an individual assessment of needs Jopportunities and initiates activities to 


and actively shares expertise with 
others. The teacher welcomes 
feedback from supervisors and 
colleagues. 


contribute to the profession. In 
addition, the teacher seeks feedback 
from supervisors and colleagues. 


Performance rating 


Requires Action Developing Accomplished Exemplary 
(0 points) (1 points) (2 points) (3 points) 
4f. Showing The teacher inconsistently adheres |The teacher strives to adhere to The teacher consistently adheres to |The teacher consistently adheres to 
Professionalism ito standards for professional conduct |standards for professional conduct and models standards for professional |standards for professional conduct 
and overall performance and overall performance conduct and overall performance and overall performance 


re requirements, including attendance requirements, including attendance = |requirements, including attendance _—_| requirements; including attendance 
(Component weight: 4%) an punctuality. land punctuality. and punctuality. and punctuality, 


The teacher fails to comply with The teacher complies minimally with |The teacher complies fully and The teacher complies fully and 
school and district regulations and school and district regulations, doing |voluntarily with school and district voluntarily with school and district 
time lines. just enough to get by. regulations. Performs with minimum of |regulations. Performs with minimum 
supervision. of supervision. 
The teacher has difficulty The teacher strives to develop 
demonstrating respect, responsibility, |behaviors that model the values of The teacher helps members of school |The teacher helps members of school 
honesty and integrity; requires fespect, responsibility, honesty and [community understand and adhere to |community understand and adhere to 
frequent support supervision; resists integrity. However, he or she requires |these professional obligations, these professional obligations. He or 
feedback from colleagues and lsome support supervision. He or she |responds well to and acts upon she actively seeks, responds well to 
administrators and does not work fesponds appropriately to and acts feedback and works cooperatively and acts upon feedback. 
cooperatively with schoo! staff. upon feedback. He or she works with school staff. 
Community, families, and students are 
aware that the teacher models the 
values of respect, honesty and 
integrity. The teacher works 
cooperatively with school staff and 
actively encourages colleagues to do 


Integrity and ethical conduct 

Service to students 

Advocacy 

Demonstrates logical thinking and makes practical decisions 
Attendance 

Punctuality 

Compliance with school and district re 
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APPENDIX A-7: 
EAGLE COUNTY PROFESSIONAL 
PRACTICES RUBRIC 
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Domain of Planning Instruction and Assessment 


Instructional Plans 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


Planning instruction encompasses decisions based on the district standards combined with knowledge of 
the disciplines taught, research-based professional practices, and the students who are to learn the curriculum. — Paula Rutherford 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


e The format of the standards-based instructional plans 
includes: review, introduction, presentation, activity, and 
closure. 
e Instructional plans include all five of the following 
components: 
e Content that 

- Connects to previous learning and 
other powerful ideas 

- Is broken down into the concepts and 
vocabulary to be learned 

Activities and materials that 
- Support the learning objective(s) 

- Provide students with choices 
- Are relevant to students’ lives 

e Grouping size, compositions, and tasks that 

- Maximize opportunities for student 
practice, student interaction, and for 
students to learn from each other 

- Hold students accountable for group 
and individual work 

Questioning that is 
- Varied 
-  Sequenced to the learning objective(s) 
- Purposeful and coherent 

Differentiated instruction that 
- Varies content, process, and product 

e = Instructional plans are observable and utilized. 


The format of the standards-based instructional plans 
includes: review, introduction, presentation, activity, 
and closure. 
Instructional plans include four of the following 
components: 
e Content that 
- Connects to previous learning and 
other powerful ideas 
- Is broken down into the concepts and 
vocabulary to be learned 
e §©Activities and materials that 
- Support the learning objective(s) 
- Provide students with choices 
- Are relevant to students’ lives 
e Grouping size, compositions, and tasks that 
- Maximize opportunities for student 
practice, student interaction, and for 
students to learn from each other 
- Hold students accountable for group 
and individual work 
e Questioning that is 
- Varied 
- Sequenced to the learning 
objective(s) 
- Purposeful and coherent 
e Differentiated instruction that 
- Varies content, process, and product 


The format of the standards-based instructional 
plans does not include: review, introduction, 
presentation, activity, or closure. 
Instructional plans do not include the following 
components: 
e Content that 
- Connects to previous learning and 
other powerful ideas 
- Is broken down into the concepts 
and vocabulary to be learned 
e §=©Activities and materials that 
- Support the learning objective(s) 
- Provide students with choices 
- Are relevant to students’ lives 
e Grouping size, compositions, and tasks that 
- Maximize opportunities for student 
practice, student interaction, and 
for students to learn from each 
other 
- Hold students accountable for 
group and individual work 
e Questioning that is 
- Varied 
-  Sequenced to the learning 
objective(s) 
- Purposeful and coherent 
e Differentiated instruction that 


- Varies content, process, and 
product 
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Domain of Planning Instruction and Assessment 


Assessment Plans 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


Effective assessment can motivate the unmotivated, restore the desire to learn, 
encourage students to keep learning and ultimately increase student achievement. — Richard Stiggins 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Assessment plans: 


e = Are aligned with state content standards and 
instructional plans. 


e Have aclear desired student performance outcome. 


e Include a variety of formative measures aligned to 
the learning objective(s). 

e Include summative measures. 

e =Include goal setting and documentation of student 
progress toward state content standards. 


e =©Are observable and utilized to inform instruction. 
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Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Assessment plans: 


Are aligned with state content standards and 
instructional plans. 


Have a clear desired student performance outcome. 


Include a variety of formative measures aligned to 
the learning objective(s). 

Include summative measures. 

Include opportunities for goal setting and 
documentation of student progress toward state 
content standards. 
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Unsatisfactory — 1 


Assessment plans: 
e = Are not aligned with state content standards. 


e Do not have a clear student performance outcome. 

e Do not include a variety of formative measures 
aligned to the learning objective(s). 

e Do not include summative measures. 

e Do not include goal setting. 


e = Are not observable or utilized to inform 
instruction. 
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This Indicator is evaluated based on a snapshot in time (lesson observed). 


Domain of Instruction 


Standards and Objectives 


Establishing and communicating a specific learning objective is essential to direct student learning and to measure student progress. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 
The standards-based learning objective(s) is specific, 
measurable, demanding, and meaningful. 


The teacher communicates, displays, and references 
the learning objective(s) throughout the lesson. 


The teacher thoroughly communicates the purpose of 
the learning objective(s). 


The teacher makes the desired student performance 
outcome thoroughly clear to all students. 


The lesson is focused on a limited set of skills and/or 
knowledge selected to help students reach the learning 
objective(s). 


There is evidence that most students demonstrate 
mastery of the learning objective(s). 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 
The standards-based learning objective(s) is specific, 
measurable, and meaningful. 


The teacher communicates and displays the learning 
objective(s). 


The teacher communicates the purpose of the learning 
objective(s). 


The teacher makes the desired student performance 
outcome clear to most students. 


The lesson is mostly focused on a limited set of skills 
and/or knowledge selected to help students reach the 
learning objective(s). 


There is evidence that most students demonstrate 
mastery of the learning objective(s). 


Unsatisfactory — 1 


The standards-based learning objective(s) is not 
specific, measurable, demanding, or meaningful. 


The learning objective(s) is not communicated. 


The purpose of the learning objective(s) is not 
communicated. 


Expectations for student performance are unclear. 
The lesson is not focused on a limited set of skills or 
knowledge selected to help students reach the learning 


objective(s). 


There is evidence that few students demonstrate 
mastery of the learning objective(s). 
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Domain of Instruction 


Presenting Instructional Content 


This Indicator is evaluated based on a snapshot in time (lesson observed). 


The teaching and learning process is the interaction between the teacher and the students with 
the content. An effective teacher delivers instruction so that the learners are actively engaged with the content. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


The teacher: 


Previews what will be learned and connects it to 
previous learning. 


Provides visuals to establish the organization of the 
lesson. 


Breaks down the concept to be learned and teaches 
each part using appropriate, effective strategies and/or 
tools. 


Highlights key concepts and ideas and connects them 
to other powerful ideas. 


Provides for frequent student interactivity with content. 


Communicates a// essential information, is on topic, 
and is succinct. 


Frequently includes internal summaries during the 
lesson. 


Responds to students’ cues to adjust instruction. 


The teacher: 


Previews what will be learned and connects it to 
previous learning. 


Provides visuals to establish the organization of the 
lesson. 


Breaks down the concept to be learned and teaches 
each part using appropriate, effective strategies and/or 
tools. 

Highlights key concepts and ideas. 


Provides for student interactivity with content. 


Communicates most essential information, is on topic, 
and is succinct. 


Includes internal summaries during the lesson. 


Responds to students’ cues to adjust instruction. 


The teacher: 


Does not preview what will be learned or connect it to 
previous learning. 


Provides ineffective or no visuals to establish the 
organization of the lesson. 


Does not appropriately break down the concept to be 
learned. 


Does not highlight key concepts and ideas or connect 
them to other powerful ideas. 


Does not provide for student interactivity with content. 
Communication is off topic. 
Includes no internal summaries during the lesson. 


Does not respond to students’ cues to adjust 
instruction. 
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Domain of Instruction 


Learning Activities & Materials 


This Indicator is evaluated based on a snapshot in time (lesson observed). 


Learning activities and materials must provide coherent, relevant learning experiences 
that will evoke and develop the desired understandings, promote interest, and lead to excellent performance. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


Activities and materials: 


Support the learning objective(s). 

Generate and sustain student engagement. 
Provide opportunities for student-to-student 
interaction. 

Provide students with choices. 

Are relevant to students’ lives. 


AND include at least one of the following: 


Student interactivity with games or game-like 
materials. 

Product creation. 

Student use of multimedia. 

Student use of technology. 

Self-direction. 

Self-monitoring. 

Student use of resources beyond the school 
curriculum texts and materials. 


Activities and materials: 


Support the learning objective(s). 

Generate and sustain student engagement. 
Provide opportunities for student-to-student 
interaction. 


AND include at least one of the following: 


Student interactivity with games or game-like 
materials. 

Product creation. 

Student use of multimedia. 

Student use of technology. 

Self-direction. 

Self-monitoring. 

Student use of resources beyond the school 
curriculum texts and materials. 


Activities and materials: 


Do not support the learning objective(s). 

Does not generate or sustain student engagement. 
Do not provide opportunities for student-to-student 
interaction. 


AND do not include: 


Student interactivity with games or game-like 
materials. 

Product creation. 

Student use of multimedia. 

Student use of technology. 

Self-direction. 

Self-monitoring. 

Student use of resources beyond the school 
curriculum texts and materials. 
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This Indicator is evaluated over time (multiple observations/lessons being observed). 


Domain of Instruction 


Learning Groups 


When students are intentionally placed into groups they experience multiple 
ways of thinking, receive more feedback, and engage in higher levels of discussion and interaction. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


Over the course of multiple observations: 


e Group size, group composition, and group tasks 
create opportunities for student practice, student 
interaction, and for students to learn from each other. 


e Group work requires students to set goals, reflect on 
the group process, and evaluate their individual 
learning. 


e All students perform their responsibilities and are held 
accountable for both group and individual work. 


Over the course of multiple observations: 


Group size, group composition, and group tasks 
create opportunities for student practice, student 
interaction, or for students to learn from each other. 


Group work requires students to reflect on the group 
process and evaluate their individual learning. 


Most students perform their responsibilities and are 


held accountable for either group or individual work. 


Over the course of multiple observations: 


Group size, group composition, and group tasks do 
not create opportunities for student practice, student 
interaction, or for students to learn from each other. 


Group work does not challenge students to set goals, 
reflect on the group process, or evaluate their 
individual learning. 


Few students perform their responsibilities and are 
held accountable for group or individual work. 
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Domain of Instruction 


Questioning 


This Indicator is evaluated based on a snapshot in time (lesson observed). 


When teachers use questions skillfully, they engage their students in an exploration of content. 
A teacher’s skill in questioning and in leading discussions makes a powerful contribution to student learning. — Charlotte Danielson 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 
Questions are varied (remembering, 
understanding, applying, analyzing, evaluating, 
creating). 


Questions are sequenced with attention to the 
learning objective(s). 


Questions are purposeful and coherent. 


Questions frequently require active student responses. 


Adequate wait time is consistently provided. 


The teacher provides opportunities for students to 
generate and answer questions relevant to the 
learning objective(s). 


The teacher asks a high frequency of questions to 
engage students. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Questions are varied (remembering, ° 


understanding, applying, analyzing, evaluating, 
creating). 


Questions are mostly sequenced with attention to e 


the learning objective(s). 


Questions are usually purposeful and coherent. e 
Questions require active student responses. e 
Adequate wait time is usually provided. ° 
The teacher provides opportunities for students to e 
generate questions relevant to the learning 

objective(s). 

The teacher asks questions to engage students. e 


The teacher calls on volunteers, non-volunteers, and 


Unsatisfactory — 1 


Questions are not varied (remembering, 
understanding, applying, analyzing, evaluating, 
creating). 


Questions are not sequenced with attention to the 
learning objective(s). 


Questions are not purposeful or coherent. 
Questions do not require active student responses. 
Adequate wait time is rarely provided. 


The teacher does not provide opportunities for students 
to generate questions relevant to the learning 
objective(s). 


The teacher does not ask a high frequency of questions 
to engage students. 


The teacher calls on volunteers, non-volunteers, and a balance of students based on race, ability, and e = The teacher rarely calls on students. 
a balance of students based on race, ability, and gender. 
gender. 
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Domain of Instruction 


Academic Feedback 


This Indicator is evaluated based on a snapshot in time (lesson observed). 


Effective academic feedback tells students where they are on the continuum of mastery, what they are doing right, 
and next steps to take. It is just-in-time, just-for-me information delivered when and where it will do the most good. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


The teacher: 


Provides a high frequency of oral and/or written 
feedback that is timely, academically-focused, 
corrective/directive, and specific to the learning 
objective(s). 


Circulates to prompt student thinking, assess each 
student’s progress, and to provide individual feedback. 


Intentionally engages students in giving academically- 
focused, corrective/directive, and specific to the 
learning objective feedback to one another. 


The teacher: 


e Provides oral and/or written feedback that is timely, 
academically-focused, corrective/directive, and 
specific to the learning objective(s). 


e Circulates to prompt student thinking, assess each 
student’s progress, and sometimes to provide 
individual feedback. 


The teacher: 


e Does not provide oral and/or written feedback that is 
timely, academically-focused, corrective/directive, or 
specific to the objective. 


e Does not circulate to prompt student thinking, assess 
each student’s progress, or provide individual 
feedback. 
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Domain of Instruction 


Critical Thinking and Problem Solving 


This Indicator is evaluated over time (multiple observations/lessons being observed). 


The teaching of critical thinking and problem solving enables students to develop mental techniques or abilities 


that allow them to reason, judge, or formulate thoughts. Teaching thinking skills consists of teaching students how to engage in these 


behaviors. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


Over the course of multiple observations, all four 
thinking/problem solving approaches are intentionally 
and explicitly taught and utilized. 


e Analytical thinking where students compare/contrast, 
evaluate/explain, classify/categorize, or draw/justify 
conclusions. 


e Practical thinking where students use, apply, and 
implement concepts and ideas they learned to work on 
real-life tasks. 


e Creative thinking where students generate ideas, 
create, design, and evaluate a final product. 


e Inquiry-based thinking where students hypothesize, 
observe, experiment, record, and report results. 


Over the course of multiple observations, three of the 
thinking/problem solving approaches are intentionally 
and explicitly taught and utilized. 


e =Analytical thinking where students compare/contrast, 
evaluate/explain, classify/categorize, or draw/justify 
conclusions. 


e Practical thinking where students use, apply, and 
implement concepts and ideas they learned to work on 
real-life tasks. 


e Creative thinking where students generate ideas, 
create, design, and evaluate a final product. 


e Inquiry-based thinking where students hypothesize, 
observe, experiment, record, and report results. 


Over the course of multiple observations, the teacher 
implements few learning experiences that thoroughly 
teach or utilize any type of thinking/problem solving. 


e Analytical thinking where students compare/contrast, 
evaluate/explain, classify/categorize, or draw/justify 
conclusions. 


e Practical thinking where students use, apply, and 
implement concepts and ideas they learned to work on 
real-life tasks. 


e Creative thinking where students generate ideas, 
create, design, and evaluate a final product. 


e Inquiry-based thinking where students hypothesize, 
observe, experiment, record, and report results. 
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Domain of Instruction 


Differentiated Instruction 


This Indicator is evaluated over time (multiple observations/lessons being observed). 


Not all students are alike. We must not differentiate who will learn what but rather how we will teach 
so that all students have access to, and support and guidance in, mastering the content. —-Paula Rutherford 


Exemplary — 5 Professional — 3 Unsatisfactory — 1 
Descriptors are met thoroughly and Descriptors are met effectively 
have significant impact on student learning. and impact student learning. 
Over the course of multiple observations, the teacher: Over the course of multiple observations, the teacher: Over the course of multiple observations, the teacher: 
e Provides differentiated CONTENT according to e Provides differentiated CONTENT according to e Does not differentiate CONTENT according to student 
individual student readiness, interest, and groups of students’ readiness, interests, and learning readiness, interest, or learning profile. 
learning profile. profiles. 
e Provides differentiated PROCESS according to e Provides differentiated PROCESS according to groups | Does not differentiate PROCESS according to student 
individual student readiness, interest, and learning of students’ readiness, interests, and learning profiles. readiness, interest, or learning profile. 
profile. e As appropriate, provides opportunities for : ; ; 
e As appropriate, provides opportunities for differentiated PRODUCT according to groups of e Does not differentiate PRODUCT according to student 
differentiated PRODUCT according to individual students’ readiness, interests, and learning profiles. readiness, interest, or learning profile. 
student readiness, interest, and learning profile. 
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This Indicator is evaluated based on a snapshot in time (lesson observed). 


Domain of Instruction 


Lesson Structure 


Time, structure, and routines blend together to create a framework for the effective delivery of a lesson. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


Lesson starts and ends on time. 


Lesson structure is coherent and includes these aspects: 
review, introduction, presentation, activity, and closure. 


The teacher provides time throughout the lesson for 
reflection on what was learned and why. 


Procedures and routines are well established, efficient, 
and demonstrated by a// students so that instructional 
time is maximized. 


Lesson starts and ends somewhat on time. 


Lesson structure is coherent and includes these aspects: 


review, introduction, presentation, activity, and closure. 


The teacher provides time for reflection on what was 
learned and why. 


Procedures and routines are well established, efficient, 
and demonstrated by most students so that instructional 
time is maximized. 


Lesson does not start and/or end on time. 


Lesson structure is not coherent and includes few of 
these aspects: review, introduction, presentation, 
activity, closure. 


The teacher does not provide time for reflection on 
what was learned. 


Procedures and routines are not well established or 
efficient. 
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Domain of Learning Environment 


Academic Expectations 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


Having high academic expectations for all students influences the instructional decisions and behavior of the teacher. 
By believing that all students can achieve, the teacher makes it a practice to behave in ways that communicate those high expectations to every student. 


Exemplary — 5 
Descriptors are met thoroughly and 


High and demanding academic expectations are set for 
every student. 


All students are consistently and meaningfully engaged. 
All students are encouraged to learn from mistakes. 


Learning opportunities are created where all students can 
experience success. 


Most students take initiative and follow through with 
their own work. 


Instructional time is optimized and expectations are set 
for better performance from every student. 


Professional — 3 


Descriptors are met effectively 


High and demanding academic expectations are set for 
every student. 


Most students are consistently and meaningfully 
engaged. 


Most students are encouraged to learn from mistakes. 


Learning opportunities are created where most students 
can experience success. 


Most students complete their work according to teacher 
expectations. 


Instructional time is optimized. 


Unsatisfactory — 1 


have significant impact on student learning. and impact student learning. 


High and demanding academic expectations are not 
set for every student. 


Students are not consistently or meaningfully 
engaged. 


Students are not encouraged to learn from mistakes. 


Learning opportunities are not created where all 
students can experience success. 


Students do not take initiative or follow through with 
their own work. 


Instructional time is not optimized. 
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Domain of Learning Environment 


Managing Student Behavior 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


Effective classroom management is essentially invisible, because when students 
are well-behaved and engaged, the focus is on instruction and learning. — Rick Smith 


Exemplary — 5 
Descriptors are met thoroughly and 


Students are consistently well-behaved and on task 
because the teacher: 


e Establishes clear standards of conduct. 


e Attends to misbehavior quickly, respectfully, and 
appropriately. 


e Addresses individual student behavior rather than the 
entire class and is sensitive to the students’ individual 
needs. 

e Uses subtle responses to correct minor disruptions. 

e = Assigns natural and logical consequences. 


e Overlooks inconsequential behavior when appropriate. 


e = Effectively uses research-based management 
strategies. 


Professional — 3 


Descriptors are met effectively 


Students are usually well-behaved and on task because 
the teacher: 


e Establishes clear standards of conduct. 


e Attends to misbehavior quickly, respectfully, and 
appropriately. 


e Addresses individual student behavior rather than the 
entire class and is sensitive to the students’ individual 
needs. 

e Uses subtle responses to correct minor disruptions. 


e Assigns natural and logical consequences. 


e Overlooks inconsequential behavior when appropriate. 


Unsatisfactory — 1 


have significant impact on student learning. and impact student learning. 


Students are not-well behaved or on task because the 
teacher does not: 


e = Establish clear standards of conduct. 


e Attend to misbehavior quickly, respectfully, or 
appropriately. 


e Address individual student behavior and is not 
sensitive to the students’ individual needs. 


e Use subtle responses to correct minor disruptions. 
e Assign natural and logical consequences. 


e Overlook inconsequential behavior. 
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Domain of Learning Environment 


Physical Environment 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


The physical environment is an important resource for learning and should provide flexibility in organizing students and activities. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


The classroom consistently: 


Is organized and understandable to a// students. 


Has supplies, equipment, and resources easily and 
readily accessible. 


Displays relevant student work. 


Is arranged to promote individual and group learning. 


Is safe and clean. 
Displays the state standards. 


Displays content-specific references or resources. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


The classroom usually: 


Is organized and understandable to most students. 
Has supplies, equipment, and resources accessible. 


Displays relevant student work. 


Is arranged to promote individual and group learning. 


Is safe and clean. 
Displays the state standards. 


Displays content-specific references or resources. 


Unsatisfactory — 1 


The classroom: 
e Is not organized and understandable to all students. 


e Does not has have supplies, equipment, or resources 
easily or readily accessible. 


e Does not display relevant student work. 


e Is not arranged to promote individual or group 
learning. 


e Is not safe or clean. 
e Does not display the state standards. 


e Does not display content-specific references or 
resources. 
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Domain of Learning Environment 


Respectful Culture 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


Creating a positive classroom climate begins with showing respect to one another and leads to a caring and supportive learning environment. 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


Consistently, 


Interactions between teacher and student are respectful. 
Interactions between students are respectful. 


Interactions among members of the class reflect 
warmth, caring, and sensitivity. 


Students take pride in their work. 


The teacher seeks out the interests and opinions of all 
students. 


The teacher thoroughly reinforces and rewards effort. 


Usually, 


Interactions between teacher and student are respectful. 
Interactions between students are respectful. 


Interactions among members of the class reflect 
warmth, caring, and sensitivity. 


Students take pride in their work. 


The teacher seeks out the interests and opinions of all 
students. 


The teacher reinforces and rewards effort. 


Interactions between teacher and student are not 
respectful. 


Interactions between students are not respectful. 


Interactions among members of the class do not 
reflect warmth, caring and sensitivity. 


Students do not take pride in their work. 


The teacher does not seek out the interests or 
opinions of students. 


The teacher does not reinforce or reward effort. 
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Domain of Learning Environment 


Classroom Procedures 


This Indicator and Domain are evaluated over time (multiple observations/lessons being observed). 


Procedures are the railroad tracks...content is the train. — Rick Smith 


Exemplary — 5 


Descriptors are met thoroughly and 
have significant impact on student learning. 


Professional — 3 


Descriptors are met effectively 
and impact student learning. 


Unsatisfactory — 1 


Consistently, classroom procedures and routines: 


e Are explicitly taught, practiced, and understood by 
students. 


e Are clear at the beginning, during the middle, and at 
the end of class, and for special situations. 


e Are efficient. 


Include non-instructional duties. 


Require all students to contribute. 


Usually, classroom procedures and routines: 


e Are explicitly taught, practiced, and understood by 
students. 


e Are clear at the beginning, during the middle, and 
at the end of class, and for special situations. 


e Are efficient. 
e Include non-instructional duties. 


e Require all students to contribute. 


Classroom procedures and routines: 


e Are not explicitly taught, practiced, and or understood by 
students. 


e Are not clear at the beginning, during middle, and at the end 
of class, or for special situations. 


e Are not efficient. 
e Do not include non-instructional duties. 


e Do not require all students to contribute. 
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Staff Management Decision Making Framework 


Contract Type Management Decision Framework Options 


Probationary Year 1 1. Probationary contract for year 2 should be issued if: 

e Teacher performance level meets or exceeds expectations, and there is no reason to 

non-renew. 
2. Termination should be proposed if: 

e Another teacher could be hired to better meet the needs of students in the school 

e Summative Annual Appraisal is below Expectations or Unsatisfactory — for example: 
© Poor classroom management practices 
o Poor relationships with students, parents, staff, etc. 
o High rate of unexcused absences and/or instances of tardiness 
Other legal reason 


Probationary Year 2 1. Probationary contract for year 3 should be issued if: 
e Teacher performance level meets or exceeds expectations, and there is no reason to 
non-renew 
o However, if ateacher has a one-year Running Cumulative Average between 0 and 
-3.00 in any one subject, a growth plan will be required for the coming year (i.e. 
team-teaching, mentoring, professional development) 
2. Termination should be proposed if: 
e Another teacher could be hired to better meet the needs of students in the school 
e Summative Annual Appraisal is below Expectations or Unsatisfactory — for example: 
o Poor classroom management practices 
© Poor relationships with students, parents, staff, etc. 
o High rate of unexcused absences and/or instances of tardiness 
o If value-added data is available, the teacher has a one-year Running Cumulative 
Average of -3.00 or lower in any subject for the most recent school year—UNLESS 
a compelling reason is offered by the Principal and supported by the School 
Improvement Officer 
Other legal reason 


Appendix A-8 99 


Staff Management Decision Making Framework 


Probationary Year 3 1. Term contract should be issued if: 
e Teacher performance is above expected levels 
o If value-added data is available, the teacher’s Cumulative Running Average is 0 (Zero) or 
higher for all subjects taught 


2. Termination should be proposed if: 
e Another teacher could be hired to better meet the needs of students in the school 
@ Summative Annual Appraisal is below Expectations or Unsatisfactory on any one or more of 
the Performance Criteria — for example: 
© Poor classroom management practices 
© Poor relationships with students, parents, staff, etc. 
o High rate of unexcused absences and/or instances of tardiness 
o. If available, for any subject the teacher has a -2.00 or lower Running Cumulative 
Average based on a 2-running average or a Running Cumulative Average of -3.00 or 
lower for the most recent school year if only one year of data is available—UNLESS a 


compelling reason is offered by the Principal and supported by the School 
Improvement Officer 
e Other legal reason 


3. Optional Probationary contract for year 4 may be issued if: 

o The teacher has a Running Cumulative Average based on 2-years of value added data 
between 0 and -2 for any subject or based on 3-years of value added data between 0 
and -3.00 in any one subject AND the principal presents a compelling reason and it is 
supported by the School Improvement Officer 
A growth plan is required for all teachers receiving a Year 4 Probationary Contract (i.e. 
team-teaching, mentoring, professional development) 
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Staff Management Decision Making Framework 


Probationary Year 4 1. Term contract should be issued if: 
e Teacher performance meets standards 
o If value-added data is available, the teacher has a Cumulative Running Average of 0 
(Zero) or higher for all subjects taught 
e Teacher performance meets standards 
o BUT, if value-added data is available, for any one subject the teacher has a Running 
Cumulative Average of greater than -1.00 but less than a O (Zero) based ona 3-year 
running average or a Running Cumulative Average of greater than -2.00 or less than a0 
(Zero) based on a 2-year running average or a Running Cumulative Average of greater 
than -3.00 but less than a O (Zero) for the most recent school year if only one year of 
data is available AND the principal presents a compelling reason and it is supported by 
the School Improvement Officer 
A growth plan is required for all teachers receiving a Term Contract that have value 
added scores below 0. (i.e. team-teaching, mentoring, professional development) 


2. Termination should be proposed if: 
e Another teacher could be hired to better meet the needs of students in the school 
¢ Summative Annual Appraisal Below Expectations or Unsatisfactory — for example: 
© Poor classroom management practices 
© Poor relationships with students, parents, staff, etc. 
© High rate of unexcused absences and/or instances of tardiness 
© If value-added data is available, the teacher has a -1.00 or lower Running Cumulative 


Average based on a 3-year running average or a -2.00 or lower Running Cumulative 
Average based on a 2-year running average or a Running Cumulative Average of -3.00 
or lower for the most recent school year if only one year of data is available—UNLESS a 
compelling reason is offered by the Principal and supported by the School 
Improvement Officer 

Other legal reason 
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Staff Management Decision Making Framework 


1. Contract should continue if: 
e Teacher performance meets or is above expected levels 
o But, if a teacher has a Running Cumulative Average that is regressive (i.e. Less than 0) in 
any one subject, a growth plan is required (i.e. team-teaching, mentoring, professional 
development) 
e There is no other compelling reason to terminate the contract 


2. Termination should be proposed if: 
¢ Unsatisfactory performance on one or more of the 34 criteria as part of the district’s 
evaluation system for teachers. 


1. Contract should continue if: 
e Teacher performance meets or is above expected levels 
© But, if a teacher has a Running Cumulative Average that is regressive (i.e. Less than 0) in 
any one subject, a growth plan is required (i.e. team-teaching, mentoring, professional 
development) 
e There is no other compelling reason to terminate the contract. 


2. Termination should be proposed if: 
e Unsatisfactory performance on one or more of the 34 criteria as part of the district’s 
evaluation system for teachers. 
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hh GRERETEES SCHOOL Teacher Summary Worksheet TE-0309 6/22/10 as 


PR Earth Spaca Sci (6-12) 6/30/15 10426 3 Supl, SubjArea Ldr 901 or more 1 
PR Earth-Space Science (6-12} 6/30/15 10623 t Comprehensive Science 1 
PR Educational Leadership 6/30/15 
PR Education Leadership (All Leve 6/30/15 
is cig signi M1iSCIENCE Title 1 Middle - Science 99.26 Y 
PR Gifted Endorsement 6/30/15 
PR MG Gen Science (5-9) 6/30/15 
PR Middle Grades Endorsement 6/30/45 
PR Middle Grades Endt 6/30/15 
PR Middle Grades General Science 6/30/15 


Clinical Education NO 


Preparing New Educators Program YES 
*These fields include only those trainings completed after 7/01/2006 


Actuat Eval Date Reviewer Name MAP Percentile(max) 


Attendance from 7/01/2009 to 06/21/2010 
Total Hours | 


Professional Duty Elsewhere 192 
Sick-Own Iliness 72 | 


264 | 


Goal: 
80% of my Advanced/Honors students will score at or above 80% on the Quarter 1 Post-test that will be given Octaber 29, 2009. 


Objectives: 
| will increase my ability to develop and deliever inquiry invesitgations with an increase in Rigor and Relevance. 
! will increase my knowlege in developing lessons that support the NGSSS and are inquiry in nature. 
Activities: 
Participate in the LIMSS Grant for the 2009-2010 school year. Meeting 10/15, 14/19, 1/9, 2/10, 3/27, 4/28. 
Participate in the PROMISE Grant for the 2009-2010 school year. Meeting 10/10, 11/7, 3/43, 4/3. 


Participate in the MISSI tnitutive to learn how to develop Curriculum invesitgations connected to the NGSSS. 


Reading Objectives: 
| will increase my knowlege of Reading Strategies that can will support content based reading. 


Reading Activities: 
| will participate in a Kagan workshop which wilt be facilated by our Reading Coach in Feb. 2010. | will incorporate at least one new strategy 
per week in my science lessons, 


Rages 4a 


7S * nati? Sait F 
Component Title Course Title End = Points — 


Component | ; Begin 

2.408.043 Advancement via Individual Determination (AVID} 26954 ‘AVID Site Team - Adams 8H 2/09 - 6 410 14 
7.507.011 Leadership Development for Teachers _ 30017 MS Science Subject Area Leader Training 09-1 8/12/09 6/7/1029 
4.015.013. ‘MiddleSchoolScience =  t—i‘isS 3 LIMSS 6/50 G/SH0s«G 
7.507.046 DataWise for Instructional Personnel 29434 Orientation to Data Wise for Instructional Perso 5/18/10 5/18/10 «6 
7.507.046 DataWise for Instructional Personnel 29433 Orientation to Data Wise for Instructional Perso 5/1740 5/17/10 6 
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2 SEEN SCHOOL aaa 


Component Component Title ID Course Title Begin End _ Points 
4.015.013 Middle School Science 28999 LIMSS S20 = §/12/10 7 
1.015.013 Middie School Science 28010 LIMSS VY27H10 3/27/10 6 
1.015.026 NGSSS: Science 28409 PROMISE Scientific Theories Spring Follow up 2/20/10 = 3/13/10 12 
1.015.013 Middle School Science 27524 LIMSS 2310 2/13/10 6 
1.015.013 Middle School Science 26786 LIMSS 4I9H10 4/9/10 6 
1.015.013 Middle School Science 25900 LIMSS 11/19/09 11/19/09 7 
1.015.026 NGSSS: Science : 27741 Scientific Theories Follow up PROMISE Institut 10/10/09 11/7/08 12 
1.015.013 Middle School Science 25405 LIMSS Leadership : , 10/15/09 10/15/09 6 
1.015.013 Middle Schoal Science 24855 LIMSS Leadership 10/3/08 = 10/3/09 6 
7.513.008 Preparing New Educators Program 23206 Support Team UPDATE Training — 7 96/09 = 9/23/08 6 
1.015.013 Middle School Science 23800 MS Science PSD Aug.19 @ Adams  aflgi0g 8/19/09 8 
7.512.005 Effectiveness Training for School improvement Team 23657 Data Analysis/SIP Plan 8/18/09 8/18/09 6 
1.015.026 NGSSS: Science 24559 Scientific Theories PROMISE Institute 720109 = 7/31/09 60 


Student Gains (grades 4-10) for: 20020800 -- M/J COMPRE SCI 2 ADV 


Adg Gain Adgq Gain Bottom Qt Adq Gain | Reading Adq Gain | Bottom at | Reading 
Math Math % | Bottom Qt Math Math% % Bottom Qt Rdg Rdg% Total 
Teacher 92 86.79% 1 100.00% 83.02% 0.00% 106 
Schea |- 148 86.05% 2 | 100.00% | 172 [| 133 | 77.33% 
District || 4,646 | 83.26% 312 | 87.30% | 5460 | 3969 | 72.81% 


Math and Reading Growth Charts (All grade levels) for: 20020800 -- M/J COMPRE SCI 2 ADV 
FCAT Math Growth - Employee FCAT Math Growth %- District 


2008 —> 2009 PALS Te 
fie: wa = 


2008 —> 2009 


Re ab 3.73% g 19.68% 2.48% 
Sg _ oR 
pl.20% 


2.06% | 0.46% 
22.30% 


AB %e 
0.37% | 16.04% ra 
0.09% | 0.99% | 28.79% 
12.00% | 32.00% | 32.00% _ 
7.72% | 29.22% | 38.03% 


0.69% | 6.86% 
0.11% | 0.92% 


Total 22.36% 


; Total 


FCAT Reading Growth- Employee FCAT Reading Growth %- District 
2008 ~> 2009 


2008 ~> 2009 


50.00% 
34.85% | 28.79% 
5:7 2%:| 56.16% 

60.20%. 
26.42% 
5.26% 


1.52% 
8.33% 


6.06% 
2.17% @ 
0.24% | 0.76% 

0.04% | 0.21% 


0.72% 
1.59% | 0.88% 
43.08% | 0.38% 


47.56% | 
39.91% 
43.18% 


15.79% 
15.29% | 0.61% 


0.88% 
0.98% | 5.38% | 34.27% 


0.44% 
0.30% 


Total 


* |Students % {Students} % Students} % Students 
123433 | 44 |seem{ 32 |2e0er%| 19 | 150a%| 22 |iasom| 3 | 260% | 0 
ie be 188. | ABE 

Schst |~ [gm [62 [azeon[ 52 [7st] 35 |rsse%] 34 |s79o%| 6 | 317% | 0 | ooom | o | oom | 189 


pistict | 2.814 | 45.45% | 1,824 | 29.40% | 957 | +546%] 408 | 659% | 189 | s05% | © | oom | 0 | oom | 6,192 | 3.08 | 


eee dé: ‘Grade 
Students %, 
123433 ; 5 30.43% 2 8.70% 0 0.00% 
Sclusd | 29 [aise] 18 [13.24%] .41 [aoism| 31 [227%] 17 |1250%] 0 | aoom] 0 Foo | 136 | 2.08 


istrict | 992 | 21.95% | 1.318 | 26.37% | 1,134 | 2aate | 684 | 14.72% | 11.15%] 0 f[ oao%] 0 | o0o% | 4.646 | 2.34 
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om) Geena SCHOOL 


20020800~M/J COMPRE SC} 2 ADV 


<i Grade C: 


radé:D: 


Students] 


Students 


Cehurh | — 


% % % 
123433 21.67% 14 11.67% 9 7.50% e) 0.00% ki 
88 [acca] 46 [2a2i%[ 30 fis7o%| 20 |ioss%] 6 | 3.16% ax 000% | 0 | 0.00% | 190 3 pee 
[oistrict | 2,916 | 46.07% | 1,908 | 014%] 965 | 15.24%] 360 | 560% | 181 | 2e0%[ 0 | ooom] 0 | ooo% | 6330 [ 3.11 | 


20020805-M/J COMPRE Be 2 ARY 


[Pes Grade’, vade:D.. es - re. aoe anes : i 

Students} % |Students Students} % ([Students} % [Students] % {Students} % |Students) GPA 

[123433 [4 J satem | 2 9.08% ig Z| 31.82%} 3 | 1seqm} 0 0.00% oO | 000% | 22 1.86 
Sebi - fom 24 ‘Liza 28 20.14% 27 | 19.42% | 37 | 26.62% i 23 16.55% | 0 i 0.00% | 0 0.00% 139 1.95 | 
District 985 | 2067% |] 1,384 | 29.04% | 1,157 | 24.28% | 702 14.73% | 538 41.29% 9] i 0.00% i 6 i 0.00% | 4,766 2.33 | 


20020800~M/l COMPRE SCI 2 ADV 


Se Grad rade: E*..: Gra 
Students % Students % Students % Students % Students % Students % Students y, Students| GPA 
[123433 76 | 63.87% 30 | 25.21% 10 8.40% 3 2.52% 0 0.00% 0 0.00% 0 6.00% | 119 3.6 
Sdus (- —_ a1 [asee%| 49 | 26.20%] 30 | te04%| 12 | 642m | 5 | 267% | © | o0o% | O | aoom | ta7 | 3.12 
District 2,806 | 44.98% | 1,986 | 31.52% | 960 15.38% | 360 5.77% 146 | 2.34% (e] 0.00% ] | 0.00% | 6,238 | 3.11 | 
20020805--MiJ GOMPRE SCI 2 ADV 
Students % Students % Students fy Students. 
123433 5 21.74% fa 21.74% 26.09% 8.70% ] 0.00% 0 0.00% 23 2 
Coli - fen 28 [2am] 31 | 2a8e%] 24 | 18.32% | ioss%| 0 | o0o% | 0 | o0o% | 131 | 2.19 | 
District 982 | 21.29% | 1,324 | 28.71% | 1,199 | 26.00% } 696 | 15.09% | 411 8.91% i] 0.00% (e) { 0.00% | 4.612 | 2.38 


oe Grade A. Grade’: Belk 

Students % Students % Students % Students} GPA 

[123433 2 50.00% 2 60,00% 0.00% @ | o00% | 0 0,00% i} 0.00% 4 | 35 
Solus - — 2 [sooo] 2 |so0o%| 0 | ooom| 0o | o.00%| 0 | com] 0 | ooo%| 0 |oom| 4 35 | 
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Columbus City School District Site Description 


District Background 


Columbus City School District, located in Franklin 
County, in Columbus, Ohio, is approximately the 
76th largest school district in the United States and 
the largest school district in Ohio (see Exhibit B-1.1 
for more information on district and school 
characteristics). Columbus did not make adequate 
yearly progress (AYP) in 2008-09 (see Exhibit B-1.2 
for proficiency rates on state assessments in reading 
and mathematics). 


History and Current Efforts to 
Measure Teacher and School 
Effectiveness 


There were several different teacher effectiveness 
measures concurrently in use in the district. With the 
state of Ohio’s Race to the Top win, the district 
anticipated possibly making other changes to 
measures of teacher effectiveness. 


e As of the site visit in July 2010, the district’s 
official teacher evaluation process was based 
on as many as six formal observations by an 
administrator. Administrators rated teachers, 
using the negotiated evaluation checklist, with 
eight areas (e.g., pupil relations, teaching 
performance, and personal characteristics). 
An overall rating of satisfactory or 
unsatisfactory was issued. 


e Since 2007, the state has provided 
value-added data at the school and grade level 
in reading and mathematics to each Ohio 
school district as part of the state 
accountability system. These data are 
generated as a result of a 2003 state law 
requiring that value-added assessments be 
incorporated into school performance 
indexes. At the same time, the Ohio 
Department of Education worked with the 
nonprofit organization Battelle for Kids to 
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Exhibit B-1.1 
District Snapshot 


Schools 128 


Students 55,000 


Teachers 4,000 


Student characteristics Percent of students 


Free and reduced-price lunch 
(FRPL) 74% 


English language learners 
(ELLs) 6% 


Students with individualized 
education programs (IEPs) 16% 


Student race/ethnicity Percent of students 


African American 62% 


American Indian <1% 


Asian 2% 


Hispanic 6% 


Multiracial 3% 


White 27% 


Exhibit B-1.2 


District Proficiency Rates in 
Mathematics and Reading, 
Grades 3-10, for 2008—09 


Grade Reading Math 


3rd grade 60% 66% 


Ath grade 67% 63% 


5th grade 53% 44% 


6th grade 59% 54% 


7th grade 50% 48% 


8th grade 49% 42% 


9th grade NA NA 


10th grade 77% 68% 


Exhibit reads: In 2008-09, 60 percent of third- 
graders scored proficient or higher on the state 
test in reading and 66 percent scored proficient 
ot higher on the state test in mathematics. 
Source: http://ilrc.ode.state.oh.us/Districts/ 

Report.asp?Dssid=26FFE8B5455DB0101 

D5B2FA632A473B1&desc=D.1.2 

- Proficiency Test Results 

(District) &str=043802, 

Columbus City,Franklin County (2008-09). 


create a professional development program related to value-added data use. This program, called 
Project SOAR, was launched in 2002, and assisted 42 school districts across the state. Columbus 
City School District volunteered to be part of Project SOAR in 2002. 


e In 2006, building from its previous work, Battelle for Kids launched the Teachers Connecting 
Achievement and Progress (ICAP) program to assist participating school districts, including 
Columbus, with teacher-level value-added analysis. Participating schools in the district (there 
were approximately 40 as of the time of the site visit) received value-added data in science, social 
studies, reading and math at grades 3-8. Only teachers and principals received copies of 
teacher-specific reports, and the district recetved summary information at the school, grade and 
subject level. This information was used for professional development conversation and 
planning purposes. 


e Teachers could volunteer for the Performance Advancement System (PAS), in which their 
effectiveness in applying a particular instructional approach was evaluated. Teachers identified an 
academic area, selected students to study, applied a particular instructional approach with those 
students, and monitored their progress using student growth measures. At the end of the 
semester or year, teachers whose students had gains greater than the district average received a 
bonus of $2,500. Teachers with classroom-level value-added reports had their PAS gains 
calculated through the value-added method; otherwise gains were examined using other district 
of state assessment data. 


e There were additional teacher effectiveness measures used in selected schools in the district. In 
2004,’ with state support, four schools in Columbus began implementing the Teacher 
Advancement Program (TAP), which focused on teacher leadership, performance pay, teacher 
accountability, and professional development. In 2006, the Ohio Department of Education won 
a Teacher Incentive Fund (TIF) grant, and Columbus was able to expand TAP to additional 
schools. Due to school closings and reconstitution, in the 2010 through 2011 school year, 
six schools planned to participate in TAP. TAP schools used a value-added score and 
observation data to determine performance bonuses. Peers and administrators observed teachers 
a total of four times per year, using the TAP observation rubric, which is based on the Charlotte 
Danielson Framework for Teaching. The rubric consisted of a number of different dimensions 
related to instruction, planning, and the learning environment. Teachers were given a score from 
1 to 5: 1 and 2 not proficient, 3 proficient, and 4 and 5 advanced. 


Strategies to Improve Equitable Access to Effective Teachers 


Columbus officials did not report using teacher effectiveness measures to examine the distribution of 
effective teachers between high- and low-poverty or high- and low-minority schools. The district had 
several programs aimed at rewarding or supporting teacher quality in all schools, including support for 
National Board Certified teachers, a monetary reward for all teachers in schools that meet AYP, an 
intensive induction program for new teachers and an intervention program for struggling teachers (the 
Peer Assistance and Remediation Program), and a program for peers to consult on problem areas 
(instructional rounds). The district also highlighted several programs that targeted certain schools or 
teachers. One program (through the Teacher Quality Enhancement grant and Teacher Quality 
Partnership) provided internships to preservice teachers and attempted to place new teachers from the 
program in high-need schools. Another program provided a $4,000 stipend for three years to teachers 
with five years’ experience and demonstrated achievement gains (which could be based on a variety of 
measutes, including value-added scores) who move to a struggling school. 
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Eagle County School District Site Description 


Exhibit B-2.1 


District Background District Snapshot 
Eagle County, Colorado, is located in the Rocky Schools 19 
Mountains about 100 miles west of Denver. The Students 6,007 
county has a population of slightly more than Teachers 495 
53,000 people, but the district covers a relatively large Student characteristics Percent of students 
geographic area. Exhibit B-2.1 shows overall Free and reduced-price lunch 
information about student background characteristics | (FRPL) 2078 
in the district, but there are variations among schools, aes fenigadi:loalnels 35% 
with several schools serving large majorities of ELL Siadent with indiveialecd 
and FRPL-eligible students. education programs (IEPs) NA 
Student race/ethnicity Percent of students 
The district did not make adequate yearly progress African American <2% 
(AYP) in the 2008-09 school year, making that the American Indian <2% 
third year of corrective action status (see Exhibit Asian <2% 
B-2.2 for proficiency rates on state assessments in Hispanic 52% 
reading and mathematics). Multiracial NA 
White 46% 
History and Current Efforts to 
Measure Teacher and School Exhibit B-2.2 
Effectiveness District Proficiency Rates in 
Mathematics and Reading, 
e In Eagle County, teacher effectiveness was Grades 3-10, for 2008-09 
measured through observations, as well as : 
student achievement growth. oae Reading Math 
3rd grade 
e A detailed observation rubric was the basis of | 4th grade 
the teacher evaluation system in Eagle 5th grade 
County. Teachers were observed formally at 6th grade 
least three times a year (by master teachers, 7th grade 
mentor teachers, and an administrator), and 8th grade 
the observations were weighted to get an 9th grade 
overall score. Eagle County had been using 10th grade 
some form of this observation rubric since Exhibit reads: In 2008-09, 71 percent of third- 
2001, when the district adopted the Teacher graders scored proficient or higher on the state 
Advancement Program (TAP). In 2006, the test in reading and 69 percent scored proficient 
district was awarded a Teacher Incentive ot higher on the state test in mathematics. 
Fund (TIP) grant to continue development Note: Results are reported here for the English 
and implementation of the TAP program. version of the test only. 
TAP’s performance pay component was Source: http://www.cde.state.co.us/cdeassess / 
controversial, and in the spring of 2007, documents/csap/csap_summary.html#2009. 


many district leaders left or were asked to 

resign. An interim superintendent was hired for one year, and a permanent superintendent has 
been in place since 2008. Since then, the district moved away from the TAP version of the 
rubric, both adding and condensing elements. These changes were made by a committee 
including district staff, principals, teachers and union representatives. It was district policy that 
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this rubric be reviewed every two years. Scores from the observation rubric were used to 
determine salary increases for teachers. 


e At the individual teacher level, the district also obtained value-added information. This 
information was disseminated to schools for use in school improvement and professional 
development planning. 


e At the building level, the district also used value-added data and other measures of student 
achievement and growth, such as the Colorado Student Assessment Program (CSAP) and 
American College Testing (ACT) for performance pay purposes. 


Strategies to Improve Equitable Access to Effective Teachers 


Eagle County did not report using its teacher effectiveness measures to examine the distribution of 
teachers between high- and low-poverty or high- and low-minority schools, although they were 
discussing within-school assignment of teachers as a result of a state grant focused on school 
improvement. The district described policies designed to improve effectiveness in all schools, including 
hiring strategies, professional development and induction, and the termination of unsatisfactory 
probationary teachers (on the basis of the district’s observation rubric). To attract teachers to high-need 
schools, the district set up a $2,500 one-time signing bonus for teachers who took a position at a 
high-need school. A two-year commitment was required. 
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Hamilton County School District Site Description 


Exhibit B-3.1 


District Background District Snapshot 
The Hamilton County School District covers the Schools 75 
county’s entire geographical area of 542 square miles Students 39,247 
and encompasses the city of Chattanooga and Teachers 2,836 
surrounding suburban and rural areas. Hamilton Student characteristics Percent of students 
County is approximately the 123rd largest school Free and reduced-price lunch 
district in the United States and the fifth largest in ane) aye 
Tennessee (see Exhibit B-3.1 for more on the a eriquage leaimers 3% 
characteristics of the district and its students). Shudeqisamihinanidialeed 

education programs (IEPs) 16% 
In 2008-09 Hamilton County School District did not Student race/ethnicity Percent of students 
make adequate yearly progress (AYP). For all students | African American 33% 
in grades K through 8 in Hamilton County, American Indian <1% 
89 percent were proficient in math and 90 percent Asian 2% 
were proficient in reading. For all students in grades Hispanic 5% 
9 through 12 in Hamilton County, 89 percent were Multiracial NA 
proficient in math and 96 percent were proficient in White 59% 
reading.® 


History and Current Efforts to Measure Teacher and School 
Effectiveness 


During the site visit, Hamilton County was in the process of making changes to its systems to measure 
teacher effectiveness and use that data, in part as a result of Tennessee’s Race to the Top (RTT) grant. 


e Anew measure of teacher practice, based on a new classroom observation framework, was being 
piloted. Until January 2010, Hamilton County’s teacher evaluation process involved three 
announced observations and walkthroughs by the principal. There was uniform dissatisfaction 
with this instrument: Almost everyone received a satisfactory evaluation; there was no inter-rater 
reliability and no consistency of use. In February of 2010, a consultant presented an idea for a 
new teacher evaluation rubric, and the superintendent approved the establishment of a steering 
committee consisting of principals, teachers, union representatives and district leaders to 
examine the rubric. This committee took the consultant’s rubric and made it the Hamilton 
County Teacher Performance Rubric. At the same time, the state was assembling a task force to 
review models of teacher evaluation as part of RTT. Hamilton County received approval from 
the state’s commissioner of education to pilot this new model. Data from the new rubric were 
intended to be used for immediate feedback and planning, as well as summative evaluation for 
individual teachers. The district also reported that they planned to use the data for professional 
development planning for the district as a whole. 


e In addition, through the Tennessee Value-Added Assessment Systems (TVAAS), Hamilton 
County received value-added data for individual teachers in all schools. While these data were 
available for use in planning, the district did not use them for a specific purpose. 
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e As part of the state’s RTT plan, Hamilton County planned to construct a new measure of 
teacher effectiveness which would combine information based on student achievement growth 
and observations. Although the relative weights had been established by the state (50 percent to 
be based on measures of practice, 35 percent on value-added scores and 15 percent on “other”’), 
other details and guidance were still being developed. 


Strategies to Improve Equitable Access to Effective Teachers 


The district did not report tracking the distribution of effective teachers by school type, although the 
state has performed such an analysis across all schools in the state and found that there are disparities in 
the numbers of effective teachers serving low- and high-poverty schools. 


The district did not report any current activities specifically focused on increasing the numbers of 
effective teachers in high-need schools. However, in 2001, as part of the first phase of the Benwood 
Initiative, a partnership between the district and a local education foundation, the district restaffed a 
number of low-performing schools and provided incentives for effective teachers (as measured through 
value-added data) to apply for positions there. 


The district did describe a number of initiatives aimed at improving teacher effectiveness in all schools, 
for example, improving preparation, recruitment and hiring processes. As of summer 2010, the district 
was planning a “grow your own teachers initiative,” which would identify the top 10 percent of students 
in Hamilton County schools and recruit them into education programs, with the promise of a job as a 
teacher. In addition, both the University of Tennessee at Knoxville and the University of Tennessee at 
Chattanooga were working on alternative route programs and new residency programs for teacher 
preparation. Hamilton County was also trying to improve the screening and interviewing of candidates, 
and providing training to principals on writing good job descriptions and interviewing candidates. The 
county planned to base interviews and selection on the new teacher observation rubric and to work with 
deans of education schools to inform them about the expectations for teacher candidates. 
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Hillsborough County Public Schools Site Description 


District Background 


Hillsborough County Public Schools is the eighth 
largest school district in the United States. The county 
covers more than 1,000 square miles, encompassing 
the City of Tampa, as well as surrounding suburbs 
and rural areas (see Exhibit 1 for more detail on 
district characteristics). 


Among all students, 60 percent scored at or above 
grade level in reading and 67 percent did so in math. 
The district did not make adequate yearly progress 
(AYP) in 2008-09 (see Exhibit 2 for proficiency rates 
by grade for reading and mathematics). 


History and Current Efforts to 
Measure Teacher and School 
Effectiveness 


Hillsborough County Public Schools was in a time of 
transition during the site visit, in June 2010, in part 
due to the state’s Race to the Top (RTT) grant and 
Hillsborough’s own $100 million grant from the Bill 
& Melinda Gates Foundation for Empowering 
Effective Teachers (EET). The district had several 
measures of teacher effectiveness in use at the time, 
and was also in the process of developing new 
measures. 


e At the time of the visit, Hillsborough used a 
measure of teacher effectiveness based on 
student achievement growth as one criterion 
for awarding performance pay bonuses. The 
other criterion was a score from a checklist 
observation of teachers. Hillsborough County 
had a long history of performance pay 
initiatives, dating back to a system that used 
portfolios prior to the start of the state’s 
current Merit Award Program (MAP), which 


Exhibit B-4.1 
District Snapshot 


Schools 


248 


Students 


191,975 


Teachers 


13,726 


Student characteristics 


Percent of students 


Free and reduced-price lunch 
(FRPL) 


52% 


English language learners 
(ELLs) 


15% 


Students with individualized 
education programs (IEPs) 


15% 


Student race/ethnicity 


Percent of students 


African American 


22% 


American Indian 


1% 


Asian 


3% 


Hispanic 


28% 


Multiracial 


6% 


White 


41% 


Exhibit B-4.2 
District Proficiency Rates in 
Mathematics and Reading, 
Grades 3-10, for 2008—09 


Grade 
3rd grade 


Reading 


Math 


4th grade 
5th grade 


6th grade 
7th grade 


8th grade 
9th grade 


10th grade 


Exhibit reads: In 2008-09, 68 percent of third- 
graders scored proficient or higher on the state 
test in reading and 76 percent scored proficient 
ot higher on the state test in math. 


Source: http://fcat.fldoe.org/results/default.asp. 


spurred the development of the student achievement measure. Beginning in 1999, a Florida state 
statute required that districts use their own funding to reward “outstanding performance,” based 
primarily on student achievement. Hillsborough developed its current system as a result of this 
law and the state programs that supported them. The district also used funds from a federal 
Teacher Incentive Fund (TIF) grant to provide additional monetary rewards in high-need 


schools. 
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e The district was also in the process of developing a value-added measure and a new teacher 
observation rubric. The value-added student achievement measure and the observation measure 
would be combined to create an overall effectiveness rating, with the achievement measure 
weighted at 40 percent and the new teacher observation weighted at 60 percent. This 
comprehensive rating would be used for compensation, tenure, and nonrenewal contract 
considerations, as well as for determining the professional development needs of teachers. Both 
the value-added scores and the new observation rubric were rolling out in 2010-11. As of 
summer 2010, the new compensation system using these effectiveness measures was planned to 
begin in 2013, when the district would have three years of value-added data. 


Strategies to Improve Equitable Access to Effective Teachers 


Hillsborough did not report using its teacher effectiveness measures to examine the distribution of 
teachers between high- and low-poverty or high- and low-minority schools. The district described several 
programs to reward and improve teacher effectiveness in all schools, such as the MAP awards and 
incentives for National Board Certified teachers. In addition, the district had several policies in place to 
try to get high-quality teachers to work in high-poverty schools, such as special hiring policies and 
additional monetary awards for teachers in the highest poverty schools, which it has designated 
Renaissance Schools. 
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Houston Independent School District Site Description 


District Background 


The Houston Independent School District is the 
seventh largest district in the United States and the 
largest in Texas. The boundaries of the district include 
the city of Houston and extend to the greater Houston 
area (see Exhibit 1 for more details on district and 
student characteristics). 


Across all groups in grades 3 to 11, 84 percent of 
students were proficient on the Texas statewide 
reading test; 74 percent were proficient on the 


Exhibit B-5.1 
District Snapshot 


Schools 


296 


Students 


200,225 


Teachers 


12,829 


Student characteristics 


Percent of students 


Free and reduced-price lunch 
(FRPL) 


81% 


English language learners 
(ELLs) 


31% 


Students with individualized 
education programs (IEPs) 


9% 


Student race/ethnicity 


Percent of students 


statewide mathematics test. The district did not make 
adequate yearly progress (AYP) in 2008-09 (see 
Exhibit 2 for proficiency rates, by grade, on state 
assessments in reading and mathematics). 


African American 28% 


American Indian <1% 
Asian 3% 
Hispanic 61% 
Multiracial NA 
White 8% 


History and Current Efforts to 
Measure Teacher and School 


Effectiveness Exhibit B-5.2 


District Proficiency Rates in 
Mathematics and Reading, 
Grades 3-10, for 2008—09 


At the time of the site visit, Houston used a 
value-added measure of teacher effectiveness, largely 
for performance pay purposes, but was considering 
additional changes to its measures of teacher 
effectiveness, which could involve development of a 
new observation system or additional uses of 
value-added data. 


Grade 
3rd grade 
4th grade 
5th grade 
6th grade 
7th grade 
8th grade 
9th grade 
10th grade 


Exhibit reads: In 2008-09, 85 percent of third- 
graders scored proficient or higher on the state 
test in reading and 82 percent scored proficient 
ot higher on the state test in math. 


Reading Math 


e Since 2007, the Houston Independent School 
District has used campus- and teacher-level 
value-added teacher effectiveness data to 
award performance bonuses to teachers, 
administrators, and other staff through the 
Accelerating Student Progress Increasing 
Results and Expectations (ASPIRE) Award 
program (with funding partly provided through 
a federal TIF grant). The district also reported 
that the data were used for professional 
development planning and identifying mentors 
and coaches. In addition, value-added data 
were made a possible criterion for termination 
decisions. 


Note: Results are reported here for the English 

version of the test only. 

Source: http://www.houstonisd.org/Research 
Accountability /Home/SP_TAKS/ 
Performance%20Reports 


/2009/HISD%20District%20Summary.pdf. 


e Houston used the state of Texas’ standard teacher evaluation process called the Professional 
Development and Appraisal System (PDAS), which included at least one classroom observation 
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lasting a minimum of 45 minutes, a summative annual conference, and written documentation 
regarding job-related teacher performance. 


e In 2009-10, the district tried a new approach to measuring teacher effectiveness called the 
staffing review process (often locally referred to as the “Bucket System”). Using this new 
method, principals were asked to evaluate various criteria of teacher performance, including the 
PDAS ratings and value-added data, to rate teachers as (1) Highly Effective, (2) Proficient, 

(3) Developing, or (4) Low-Performing. 


Strategies to Improve Equitable Access to Effective Teachers 


The district has analyzed effectiveness data, by school characteristics, and found disparities in 
effectiveness. A 2010 study by the New Teacher Project for the Houston Independent School District 
found that schools with more than 75 percent of students eligible for FRPL had a smaller percentage of 
effective teachers, as measured by value-added data, compared with schools with 75 percent or less 
FRPL. 


In order to improve teacher effectiveness in all schools, the district had policies to increase the selectivity 
in hiring, use effectiveness data for termination decisions and prevent ineffective teachers from 
transferring. The district also had a mentoring and induction program for all new teachers. In addition, 
the district highlighted a specific new initiative targeting low-performing schools (the Effective Teacher 
Pipeline Project), which attempted to identify effective teachers and relocate them in clusters to 
low-performing schools. Teachers who agreed to transfer received a $10,000 stipend for two years. 
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Study Methods 


AIR staff worked with the five study districts to plan visits lasting approximately two days per district, to 
speak with district and school-level staff. Site visit teams, consisting of two AIR staff, reviewed district 
websites prior to the visits to learn about initiatives in the districts. From approximately May through 
August 2010, AIR staff visited the five districts to obtain detailed information from district-level staff 
and union representatives, as well as principals from four schools. We spoke to each respondent 
regarding 


e How the district’s approach to measuring teacher quality was being implemented from the 
perspective of the district, school leaders and teachers 


e How the district, school leaders, and teachers were using the information provided by the 
measures, with a special focus on schools serving disadvantaged students 


Interviews focused on the characteristics of the new measures of teacher quality, interviewees’ views of 
the measures, how they were being used (including successes and challenges), what they were learning 
from the new measures and what results they had observed. Interviews took about one hour each and 
were recorded. Documents were also collected both before and during site visits. Analysis of these 
interviews and extant data contributed to site-specific summaries, which were the basis for report 
writing. These summaries were reviewed by participating districts for accuracy. 
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List of Resources 


Following are short descriptions of suggested websites that provide additional information about 
identifying effective teachers, building systems to improve teacher effectiveness and taking targeted 
actions to improve equitable access to effective teachers. 


National Comprehensive Center for Teacher Quality 

http: //www.tqsource.org/ 

The National Comprehensive Center for Teacher Quality (TQ Center) is a federally funded technical 
assistance center focused on the quality of teaching—especially in high-poverty, low-performing and 
hard-to-staff schools. By using the center’s “filter by topic” or “keyword” functions, users can find 
resources related to teacher effectiveness, teacher evaluation, equitable distribution of teachers, 
professional development and other relevant topics. The TQ Center provides policy briefs and reviews, 
research syntheses, interactive tools and workbooks, and other resources. 


Center for Educator Compensation Reform 

http://www.cect.ed.gov/ 

The Center for Educator Compensation Reform (CECR) is a federally funded technical assistance center 
designed to raise national awareness of effective strategies for educator compensation reform. The 
website serves as the primary online repository for information, tools, and resources to support Teacher 
Incentive Fund (TIF) grantees in particular. The website also provides brief summaries of TIF grantee 
projects, as well as other compensation reform projects around the country, research syntheses, and 
annotated bibliographies, and policy briefs. 


Institute of Education Sciences Regional Education Laboratories 

http://ies.ed.gov/ncee/edlabs 

The Regional Educational Laboratory (REL) program consists of a network of ten laboratories that serve 
the educational needs of a designated region by providing access to high-quality scientifically valid 
education research through applied research and development projects, studies, and other related 
technical assistance activities. Using the REL Lookup feature, users can search for publications related to 
teacher effectiveness and equitable distribution of effective teachers. RELs produce information on 
policies in use in their regions, as well as large-scale rigorous research studies. 


The Consortium for Policy Research in Education 

http://cpre.wceruw.org/ 

The Consortium for Policy Research in Education (CPRE) comprises seven universities in partnership to 
conduct research on education reform, policy, and finance. The University of Wisconsin CPRE website 
includes case studies on teacher compensation and links to resources on teacher evaluation. The main 
CPRE website, at http://www.cpre.org, provides additional research reports and policy briefs on teacher 
quality and compensation. 


National Center on Performance Incentives 

http://www.performanceincentives.org 

The National Center on Performance Incentives (NCPI) is a federally funded center designed to 
investigate the effects of financial incentives for teachers, administrators and schools on the quality of 
teaching and learning. NCPI’s work involves a series of rigorous research initiatives, including 
randomized field trials and evaluations of existing pay-for-performance programs. Resources available 
include reports of large-scale research and evaluation projects, as well as policy briefs related to 
performance incentives. 


Appendix D: 137 
List of Resources 


20 < 
~ STATES OF! 


The Department of Education’s Mission is to promote 
student achievement and preparation for global competitiveness 
by fostering educational excellence and ensuring equal access. 

www.ed.gov 


